Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 926160 Details for
Bug 1129398
Missing parameter validation when adding new storage domain with advanced options
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log file
vdsm.log (text/x-log), 7.59 MB, created by
Gal Amado
on 2014-08-12 16:46:11 UTC
(
hide
)
Description:
vdsm log file
Filename:
MIME Type:
Creator:
Gal Amado
Created:
2014-08-12 16:46:11 UTC
Size:
7.59 MB
patch
obsolete
>Dummy-31::DEBUG::2014-08-12 15:01:01,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:01,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120393 s, 85.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:01:03,412::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:01:03,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658194 s, 6.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:01:03,427::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:01:03,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:03,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:03,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:03,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:03,428::__init__::225::IOProcess::(_processLogs) (14260) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:03,428::__init__::225::IOProcess::(_processLogs) (14260) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:03,428::__init__::225::IOProcess::(_processLogs) (14260) Building response >Thread-25::DEBUG::2014-08-12 15:01:03,428::__init__::225::IOProcess::(_processLogs) (14260) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:03,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:03,428::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:01:03,430::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:01:03,430::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:03,430::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:03,430::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:03,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:03,430::__init__::225::IOProcess::(_processLogs) (14261) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:03,431::__init__::225::IOProcess::(_processLogs) (14261) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:03,431::__init__::225::IOProcess::(_processLogs) (14261) Building response >Thread-25::DEBUG::2014-08-12 15:01:03,431::__init__::225::IOProcess::(_processLogs) (14261) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:03,431::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:03,431::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:01:03,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:03,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121017 s, 84.6 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:01:04,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:01:04,597::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616518 s, 6.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:04,981::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:04,982::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:04,983::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:05,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:05,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012189 s, 84.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:06,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f5170a5-0dbe-49c2-991b-9e7dc484833a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:06,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:01:06,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658194', 'lastCheck': '2.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616518', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:01:06,200::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f5170a5-0dbe-49c2-991b-9e7dc484833a`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658194', 'lastCheck': '2.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616518', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:01:06,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f5170a5-0dbe-49c2-991b-9e7dc484833a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:06,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:06,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:06,201::task::993::Storage.TaskManager.Task::(_decref) Task=`2f5170a5-0dbe-49c2-991b-9e7dc484833a`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:01:06,226::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:07,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:07,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121518 s, 84.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:07,898::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:01:07,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`542d28dd-5fdf-4765-ac0a-f0243e8247a6`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:07,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:01:07,935::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:07,935::task::1191::Storage.TaskManager.Task::(prepare) Task=`542d28dd-5fdf-4765-ac0a-f0243e8247a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:07,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`542d28dd-5fdf-4765-ac0a-f0243e8247a6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:07,936::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:07,936::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:07,936::task::993::Storage.TaskManager.Task::(_decref) Task=`542d28dd-5fdf-4765-ac0a-f0243e8247a6`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:01:07,948::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:01:07,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6dd2384-9e9e-48d0-bacd-62dce3f55290`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:01:07,949::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:01:07,949::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`caaabce8-538b-43a2-8ffb-33c627f230e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:01:07,949::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:01:07,950::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:01:07,950::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`caaabce8-538b-43a2-8ffb-33c627f230e2`::Granted request >Thread-32::DEBUG::2014-08-12 15:01:07,950::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c6dd2384-9e9e-48d0-bacd-62dce3f55290`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:01:07,950::task::993::Storage.TaskManager.Task::(_decref) Task=`c6dd2384-9e9e-48d0-bacd-62dce3f55290`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:01:07,963::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:07,963::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6dd2384-9e9e-48d0-bacd-62dce3f55290`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:07,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6dd2384-9e9e-48d0-bacd-62dce3f55290`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:01:07,964::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:01:07,964::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:01:07,964::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:01:07,964::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:01:07,965::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:01:07,965::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:01:07,965::task::993::Storage.TaskManager.Task::(_decref) Task=`c6dd2384-9e9e-48d0-bacd-62dce3f55290`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:01:09,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:09,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121448 s, 84.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:09,989::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:09,990::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:09,991::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:11,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:11,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012023 s, 85.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:01:13,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:01:13,444::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713871 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:01:13,447::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:01:13,447::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:13,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:13,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:13,448::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:13,448::__init__::225::IOProcess::(_processLogs) (14262) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:13,448::__init__::225::IOProcess::(_processLogs) (14262) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:13,449::__init__::225::IOProcess::(_processLogs) (14262) Building response >Thread-25::DEBUG::2014-08-12 15:01:13,449::__init__::225::IOProcess::(_processLogs) (14262) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:13,449::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:13,449::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:01:13,450::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:01:13,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:13,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:13,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:13,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:13,451::__init__::225::IOProcess::(_processLogs) (14263) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:13,451::__init__::225::IOProcess::(_processLogs) (14263) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:13,451::__init__::225::IOProcess::(_processLogs) (14263) Building response >Thread-25::DEBUG::2014-08-12 15:01:13,451::__init__::225::IOProcess::(_processLogs) (14263) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:13,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:13,452::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:01:14,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:14,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012331 s, 83.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:01:14,599::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:01:14,611::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633004 s, 6.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:14,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:14,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:14,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:16,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:16,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200037 s, 51.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:17,981::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:01:17,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c9c7c39-3330-454b-8c43-e8ee18766b9e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:17,982::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:01:17,995::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:17,995::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c9c7c39-3330-454b-8c43-e8ee18766b9e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:17,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c9c7c39-3330-454b-8c43-e8ee18766b9e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:17,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:17,995::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:17,996::task::993::Storage.TaskManager.Task::(_decref) Task=`7c9c7c39-3330-454b-8c43-e8ee18766b9e`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:01:18,007::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:01:18,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f84dda8-7adf-429b-9a5c-5b569be54a7b`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:01:18,007::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:01:18,008::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`56c80f2e-9b1d-422a-81aa-2d5d34119eed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:01:18,008::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:01:18,008::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:01:18,008::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`56c80f2e-9b1d-422a-81aa-2d5d34119eed`::Granted request >Thread-32::DEBUG::2014-08-12 15:01:18,009::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9f84dda8-7adf-429b-9a5c-5b569be54a7b`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:01:18,009::task::993::Storage.TaskManager.Task::(_decref) Task=`9f84dda8-7adf-429b-9a5c-5b569be54a7b`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:01:18,021::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:18,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f84dda8-7adf-429b-9a5c-5b569be54a7b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:18,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f84dda8-7adf-429b-9a5c-5b569be54a7b`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:01:18,022::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:01:18,022::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:01:18,022::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:01:18,023::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:01:18,023::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:01:18,023::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:01:18,023::task::993::Storage.TaskManager.Task::(_decref) Task=`9f84dda8-7adf-429b-9a5c-5b569be54a7b`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:01:18,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:18,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131813 s, 77.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:20,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:20,007::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:20,018::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:20,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:20,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131269 s, 78.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:21,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e2ef4c4-866d-44a7-b1b4-27a44761e063`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:21,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:01:21,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713871', 'lastCheck': '7.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633004', 'lastCheck': '6.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:01:21,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e2ef4c4-866d-44a7-b1b4-27a44761e063`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713871', 'lastCheck': '7.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633004', 'lastCheck': '6.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:01:21,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e2ef4c4-866d-44a7-b1b4-27a44761e063`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:21,324::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:21,325::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:21,325::task::993::Storage.TaskManager.Task::(_decref) Task=`3e2ef4c4-866d-44a7-b1b4-27a44761e063`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:01:21,353::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:22,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:22,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133738 s, 76.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:01:23,075::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-16::DEBUG::2014-08-12 15:01:23,453::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:01:23,465::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666935 s, 6.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:01:23,468::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:01:23,468::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:23,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:23,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:23,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:23,469::__init__::225::IOProcess::(_processLogs) (14264) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:23,469::__init__::225::IOProcess::(_processLogs) (14264) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:23,469::__init__::225::IOProcess::(_processLogs) (14264) Building response >Thread-25::DEBUG::2014-08-12 15:01:23,469::__init__::225::IOProcess::(_processLogs) (14264) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:23,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:23,470::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:01:23,470::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:01:23,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:23,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:23,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:23,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:23,471::__init__::225::IOProcess::(_processLogs) (14265) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:23,471::__init__::225::IOProcess::(_processLogs) (14265) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:23,472::__init__::225::IOProcess::(_processLogs) (14265) Building response >Thread-25::DEBUG::2014-08-12 15:01:23,472::__init__::225::IOProcess::(_processLogs) (14265) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:23,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:23,472::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:01:24,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:24,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128664 s, 79.6 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:01:24,613::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:01:24,624::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645077 s, 6.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:25,024::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:25,025::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:25,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:26,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:26,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135466 s, 75.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:28,038::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:01:28,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`c56db093-8c9f-4e2c-a0f3-2e022b45b368`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:28,039::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:01:28,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:28,051::task::1191::Storage.TaskManager.Task::(prepare) Task=`c56db093-8c9f-4e2c-a0f3-2e022b45b368`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:28,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`c56db093-8c9f-4e2c-a0f3-2e022b45b368`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:28,052::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:28,052::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:28,052::task::993::Storage.TaskManager.Task::(_decref) Task=`c56db093-8c9f-4e2c-a0f3-2e022b45b368`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:01:28,065::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:01:28,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d5dc442-1d13-4ae0-b784-50d9ba2051ac`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:01:28,065::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:01:28,066::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`b946e138-6bfd-44ad-8110-7870c1bae9e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:01:28,066::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:01:28,066::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:01:28,066::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`b946e138-6bfd-44ad-8110-7870c1bae9e3`::Granted request >Thread-32::DEBUG::2014-08-12 15:01:28,067::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d5dc442-1d13-4ae0-b784-50d9ba2051ac`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:01:28,067::task::993::Storage.TaskManager.Task::(_decref) Task=`8d5dc442-1d13-4ae0-b784-50d9ba2051ac`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:01:28,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:28,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d5dc442-1d13-4ae0-b784-50d9ba2051ac`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:28,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d5dc442-1d13-4ae0-b784-50d9ba2051ac`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:01:28,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:01:28,080::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:01:28,080::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:01:28,081::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:01:28,081::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:01:28,081::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:01:28,081::task::993::Storage.TaskManager.Task::(_decref) Task=`8d5dc442-1d13-4ae0-b784-50d9ba2051ac`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:01:28,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:28,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128951 s, 79.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:30,048::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:30,048::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:30,059::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:30,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:30,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127031 s, 80.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:01:32,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:32,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132328 s, 77.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:01:33,473::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:01:33,485::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657709 s, 6.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:01:33,488::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:01:33,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:33,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:33,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:33,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:33,489::__init__::225::IOProcess::(_processLogs) (14266) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:33,489::__init__::225::IOProcess::(_processLogs) (14266) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:33,489::__init__::225::IOProcess::(_processLogs) (14266) Building response >Thread-25::DEBUG::2014-08-12 15:01:33,489::__init__::225::IOProcess::(_processLogs) (14266) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:33,490::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:33,490::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:01:33,491::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:01:33,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:33,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:33,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:33,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:33,491::__init__::225::IOProcess::(_processLogs) (14267) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:33,492::__init__::225::IOProcess::(_processLogs) (14267) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:33,492::__init__::225::IOProcess::(_processLogs) (14267) Building response >Thread-25::DEBUG::2014-08-12 15:01:33,492::__init__::225::IOProcess::(_processLogs) (14267) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:33,492::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:33,492::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:01:34,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:01:34,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601569 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:01:34,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:34,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173632 s, 59.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:35,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:35,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:35,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:01:36,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`65664e66-b0e7-4d87-b0c2-c8b58a6d55be`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:36,442::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:01:36,443::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657709', 'lastCheck': '2.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601569', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:01:36,443::task::1191::Storage.TaskManager.Task::(prepare) Task=`65664e66-b0e7-4d87-b0c2-c8b58a6d55be`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657709', 'lastCheck': '2.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601569', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:01:36,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`65664e66-b0e7-4d87-b0c2-c8b58a6d55be`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:36,443::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:36,443::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:36,444::task::993::Storage.TaskManager.Task::(_decref) Task=`65664e66-b0e7-4d87-b0c2-c8b58a6d55be`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:01:36,465::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:36,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:36,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132403 s, 77.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:38,103::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:01:38,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`b345ad51-ff85-4515-9232-ef92a0f9290f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:38,104::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:01:38,116::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:38,116::task::1191::Storage.TaskManager.Task::(prepare) Task=`b345ad51-ff85-4515-9232-ef92a0f9290f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:38,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`b345ad51-ff85-4515-9232-ef92a0f9290f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:38,116::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:38,116::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:38,117::task::993::Storage.TaskManager.Task::(_decref) Task=`b345ad51-ff85-4515-9232-ef92a0f9290f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:01:38,128::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:01:38,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4c029e4-4113-427e-a3fc-34d036183916`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:01:38,129::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:01:38,129::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`38ba5171-514a-40d8-bbf2-2a758663a445`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:01:38,130::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:01:38,130::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:01:38,130::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`38ba5171-514a-40d8-bbf2-2a758663a445`::Granted request >Thread-32::DEBUG::2014-08-12 15:01:38,130::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e4c029e4-4113-427e-a3fc-34d036183916`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:01:38,131::task::993::Storage.TaskManager.Task::(_decref) Task=`e4c029e4-4113-427e-a3fc-34d036183916`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:01:38,143::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:38,143::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4c029e4-4113-427e-a3fc-34d036183916`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:38,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4c029e4-4113-427e-a3fc-34d036183916`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:01:38,144::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:01:38,144::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:01:38,144::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:01:38,144::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:01:38,144::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:01:38,145::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:01:38,145::task::993::Storage.TaskManager.Task::(_decref) Task=`e4c029e4-4113-427e-a3fc-34d036183916`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:01:38,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:39,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130631 s, 78.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:40,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:40,090::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:40,100::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:41,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:41,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131702 s, 77.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:01:43,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:43,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131845 s, 77.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:01:43,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:01:43,505::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749939 s, 5.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:01:43,508::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:01:43,508::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:43,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:43,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:43,509::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:43,509::__init__::225::IOProcess::(_processLogs) (14268) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:43,509::__init__::225::IOProcess::(_processLogs) (14268) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:43,509::__init__::225::IOProcess::(_processLogs) (14268) Building response >Thread-25::DEBUG::2014-08-12 15:01:43,509::__init__::225::IOProcess::(_processLogs) (14268) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:43,510::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:43,510::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:01:43,511::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:01:43,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:43,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:43,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:43,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:43,512::__init__::225::IOProcess::(_processLogs) (14269) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:43,512::__init__::225::IOProcess::(_processLogs) (14269) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:43,512::__init__::225::IOProcess::(_processLogs) (14269) Building response >Thread-25::DEBUG::2014-08-12 15:01:43,512::__init__::225::IOProcess::(_processLogs) (14269) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:43,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:43,512::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:01:44,639::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:01:44,651::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665723 s, 6.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:45,107::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:45,108::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:45,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:45,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:45,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131908 s, 77.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:01:47,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:47,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132443 s, 77.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:48,161::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:01:48,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`78646d28-b032-4f7c-8bf1-21911654f09a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:48,162::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:01:48,174::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:48,174::task::1191::Storage.TaskManager.Task::(prepare) Task=`78646d28-b032-4f7c-8bf1-21911654f09a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:48,174::task::595::Storage.TaskManager.Task::(_updateState) Task=`78646d28-b032-4f7c-8bf1-21911654f09a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:48,174::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:48,175::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:48,175::task::993::Storage.TaskManager.Task::(_decref) Task=`78646d28-b032-4f7c-8bf1-21911654f09a`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:01:48,187::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:01:48,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`2251feb8-bb5a-4d44-8316-44455c1f0c69`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:01:48,188::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:01:48,188::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d2ecec33-844d-45ca-bb60-ed044062778b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:01:48,188::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:01:48,189::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:01:48,189::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d2ecec33-844d-45ca-bb60-ed044062778b`::Granted request >Thread-32::DEBUG::2014-08-12 15:01:48,189::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2251feb8-bb5a-4d44-8316-44455c1f0c69`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:01:48,189::task::993::Storage.TaskManager.Task::(_decref) Task=`2251feb8-bb5a-4d44-8316-44455c1f0c69`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:01:48,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:48,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`2251feb8-bb5a-4d44-8316-44455c1f0c69`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:48,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`2251feb8-bb5a-4d44-8316-44455c1f0c69`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:01:48,202::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:01:48,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:01:48,203::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:01:48,203::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:01:48,203::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:01:48,203::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:01:48,203::task::993::Storage.TaskManager.Task::(_decref) Task=`2251feb8-bb5a-4d44-8316-44455c1f0c69`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:01:48,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`98adcd43-21b0-4c4a-825f-95c25d6041fd`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:01:48,574::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:01:48,574::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:01:48,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`98adcd43-21b0-4c4a-825f-95c25d6041fd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:01:48,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`98adcd43-21b0-4c4a-825f-95c25d6041fd`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:01:48,575::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:01:48,575::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:01:48,575::task::993::Storage.TaskManager.Task::(_decref) Task=`98adcd43-21b0-4c4a-825f-95c25d6041fd`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:01:48,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ac956c2-d5ca-41af-99b0-0a0689dbd31d`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:01:48,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:01:48,576::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:01:48,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ac956c2-d5ca-41af-99b0-0a0689dbd31d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:01:48,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ac956c2-d5ca-41af-99b0-0a0689dbd31d`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:01:48,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:01:48,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:01:48,576::task::993::Storage.TaskManager.Task::(_decref) Task=`7ac956c2-d5ca-41af-99b0-0a0689dbd31d`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:01:48,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`52b92616-6b68-4ea9-828e-d23d26fa2a8e`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:01:48,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:01:48,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:01:48,577::task::1191::Storage.TaskManager.Task::(prepare) Task=`52b92616-6b68-4ea9-828e-d23d26fa2a8e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:01:48,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`52b92616-6b68-4ea9-828e-d23d26fa2a8e`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:01:48,578::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:01:48,578::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:01:48,578::task::993::Storage.TaskManager.Task::(_decref) Task=`52b92616-6b68-4ea9-828e-d23d26fa2a8e`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:01:48,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5b72e72-33d7-452a-ae6e-a01ef2370e8c`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:01:48,579::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:01:48,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:01:48,579::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5b72e72-33d7-452a-ae6e-a01ef2370e8c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:01:48,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5b72e72-33d7-452a-ae6e-a01ef2370e8c`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:01:48,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:01:48,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:01:48,580::task::993::Storage.TaskManager.Task::(_decref) Task=`f5b72e72-33d7-452a-ae6e-a01ef2370e8c`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:01:49,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:49,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132934 s, 77.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:50,116::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:50,117::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:50,123::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:51,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:51,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133207 s, 76.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:51,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`15178dc2-1840-4fa1-816c-1b88526401ad`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:51,564::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:01:51,564::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749939', 'lastCheck': '8.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665723', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:01:51,564::task::1191::Storage.TaskManager.Task::(prepare) Task=`15178dc2-1840-4fa1-816c-1b88526401ad`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749939', 'lastCheck': '8.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665723', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:01:51,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`15178dc2-1840-4fa1-816c-1b88526401ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:51,565::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:51,565::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:51,565::task::993::Storage.TaskManager.Task::(_decref) Task=`15178dc2-1840-4fa1-816c-1b88526401ad`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:01:51,587::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:01:53,119::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:01:53,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:53,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132956 s, 77.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:01:53,543::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:01:53,556::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000973867 s, 4.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:01:53,569::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:01:53,569::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:53,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:53,570::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:01:53,571::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:53,571::__init__::225::IOProcess::(_processLogs) (14270) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:53,572::__init__::225::IOProcess::(_processLogs) (14270) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:53,573::__init__::225::IOProcess::(_processLogs) (14270) Building response >Thread-25::DEBUG::2014-08-12 15:01:53,573::__init__::225::IOProcess::(_processLogs) (14270) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:53,574::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:53,574::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:01:53,577::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:01:53,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:01:53,578::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:01:53,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:01:53,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:01:53,580::__init__::225::IOProcess::(_processLogs) (14271) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:01:53,580::__init__::225::IOProcess::(_processLogs) (14271) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:01:53,581::__init__::225::IOProcess::(_processLogs) (14271) Building response >Thread-25::DEBUG::2014-08-12 15:01:53,581::__init__::225::IOProcess::(_processLogs) (14271) Queuing response >Thread-25::DEBUG::2014-08-12 15:01:53,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:01:53,582::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:01:54,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:01:54,665::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668841 s, 6.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:55,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:55,130::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:01:55,140::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:01:55,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:55,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121829 s, 84.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:01:57,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:57,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012158 s, 84.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:01:58,221::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:01:58,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`500ef920-2879-4b63-a91b-afd86052951f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:01:58,222::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:01:58,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:58,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`500ef920-2879-4b63-a91b-afd86052951f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:01:58,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`500ef920-2879-4b63-a91b-afd86052951f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:01:58,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:01:58,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:01:58,246::task::993::Storage.TaskManager.Task::(_decref) Task=`500ef920-2879-4b63-a91b-afd86052951f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:01:58,259::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:01:58,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3269b04-a39f-43d7-9a17-0d0810da6efc`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:01:58,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:01:58,262::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c22fd470-f54d-40f2-979e-2b04d1d9ca10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:01:58,262::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:01:58,263::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:01:58,263::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c22fd470-f54d-40f2-979e-2b04d1d9ca10`::Granted request >Thread-32::DEBUG::2014-08-12 15:01:58,263::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c3269b04-a39f-43d7-9a17-0d0810da6efc`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:01:58,263::task::993::Storage.TaskManager.Task::(_decref) Task=`c3269b04-a39f-43d7-9a17-0d0810da6efc`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:01:58,276::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:58,277::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3269b04-a39f-43d7-9a17-0d0810da6efc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:01:58,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3269b04-a39f-43d7-9a17-0d0810da6efc`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:01:58,277::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:01:58,277::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:01:58,277::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:01:58,277::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:01:58,278::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:01:58,278::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:01:58,278::task::993::Storage.TaskManager.Task::(_decref) Task=`c3269b04-a39f-43d7-9a17-0d0810da6efc`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:01:59,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:01:59,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122017 s, 83.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:00,147::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:00,148::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:00,152::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:01,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:01,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124838 s, 82.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:02:03,585::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:02:03,597::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660276 s, 6.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:02:03,600::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:02:03,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:03,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:03,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:03,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:03,601::__init__::225::IOProcess::(_processLogs) (14272) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:03,601::__init__::225::IOProcess::(_processLogs) (14272) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:03,601::__init__::225::IOProcess::(_processLogs) (14272) Building response >Thread-25::DEBUG::2014-08-12 15:02:03,601::__init__::225::IOProcess::(_processLogs) (14272) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:03,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:03,602::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:02:03,602::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:02:03,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:03,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:03,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:03,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:03,603::__init__::225::IOProcess::(_processLogs) (14273) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:03,603::__init__::225::IOProcess::(_processLogs) (14273) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:03,604::__init__::225::IOProcess::(_processLogs) (14273) Building response >Thread-25::DEBUG::2014-08-12 15:02:03,604::__init__::225::IOProcess::(_processLogs) (14273) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:03,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:03,604::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:02:03,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:03,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125691 s, 81.5 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:02:04,667::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:02:04,678::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655806 s, 6.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:05,158::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:05,159::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:05,175::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:05,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:06,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121708 s, 84.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:06,685::task::595::Storage.TaskManager.Task::(_updateState) Task=`72d802e6-d5e7-4bbd-b9c7-455d5451d6a0`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:06,685::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:02:06,685::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660276', 'lastCheck': '3.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655806', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:02:06,686::task::1191::Storage.TaskManager.Task::(prepare) Task=`72d802e6-d5e7-4bbd-b9c7-455d5451d6a0`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660276', 'lastCheck': '3.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655806', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:02:06,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`72d802e6-d5e7-4bbd-b9c7-455d5451d6a0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:06,686::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:06,686::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:06,686::task::993::Storage.TaskManager.Task::(_decref) Task=`72d802e6-d5e7-4bbd-b9c7-455d5451d6a0`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:02:06,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:08,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:08,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01233 s, 83.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:08,298::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:02:08,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ecbc369-c614-4403-9068-710ffc204557`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:08,299::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:02:08,329::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:08,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ecbc369-c614-4403-9068-710ffc204557`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:08,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ecbc369-c614-4403-9068-710ffc204557`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:08,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:08,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:08,330::task::993::Storage.TaskManager.Task::(_decref) Task=`7ecbc369-c614-4403-9068-710ffc204557`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:02:08,342::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:02:08,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`39e5749b-ee13-4fd6-ac06-54e43766eb5b`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:02:08,343::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:02:08,343::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`79cf2bbf-8c35-4261-8106-33b529eb2ea3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:02:08,344::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:02:08,344::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:02:08,344::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`79cf2bbf-8c35-4261-8106-33b529eb2ea3`::Granted request >Thread-32::DEBUG::2014-08-12 15:02:08,344::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`39e5749b-ee13-4fd6-ac06-54e43766eb5b`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:02:08,345::task::993::Storage.TaskManager.Task::(_decref) Task=`39e5749b-ee13-4fd6-ac06-54e43766eb5b`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:02:08,357::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:08,357::task::1191::Storage.TaskManager.Task::(prepare) Task=`39e5749b-ee13-4fd6-ac06-54e43766eb5b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:08,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`39e5749b-ee13-4fd6-ac06-54e43766eb5b`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:02:08,358::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:02:08,358::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:02:08,358::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:02:08,358::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:02:08,359::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:02:08,359::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:02:08,359::task::993::Storage.TaskManager.Task::(_decref) Task=`39e5749b-ee13-4fd6-ac06-54e43766eb5b`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:02:10,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:10,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124126 s, 82.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:10,182::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:10,183::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:10,193::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:12,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:12,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120284 s, 85.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:02:13,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:02:13,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697438 s, 5.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:02:13,620::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:02:13,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:13,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:13,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:13,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:13,621::__init__::225::IOProcess::(_processLogs) (14274) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:13,622::__init__::225::IOProcess::(_processLogs) (14274) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:13,622::__init__::225::IOProcess::(_processLogs) (14274) Building response >Thread-25::DEBUG::2014-08-12 15:02:13,622::__init__::225::IOProcess::(_processLogs) (14274) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:13,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:13,622::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:02:13,623::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:02:13,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:13,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:13,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:13,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:13,624::__init__::225::IOProcess::(_processLogs) (14275) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:13,624::__init__::225::IOProcess::(_processLogs) (14275) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:13,624::__init__::225::IOProcess::(_processLogs) (14275) Building response >Thread-25::DEBUG::2014-08-12 15:02:13,624::__init__::225::IOProcess::(_processLogs) (14275) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:13,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:13,625::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:02:14,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:14,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131062 s, 78.1 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:02:14,680::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:02:14,692::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000811245 s, 5.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:15,199::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:15,200::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:15,210::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:16,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:16,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185693 s, 55.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:18,375::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [66f05af2] >Thread-14::DEBUG::2014-08-12 15:02:18,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`f992f429-1d0e-45b0-ae5e-2a5c802a0728`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:18,376::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:02:18,389::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:18,389::task::1191::Storage.TaskManager.Task::(prepare) Task=`f992f429-1d0e-45b0-ae5e-2a5c802a0728`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:18,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`f992f429-1d0e-45b0-ae5e-2a5c802a0728`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:18,389::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:18,389::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:18,390::task::993::Storage.TaskManager.Task::(_decref) Task=`f992f429-1d0e-45b0-ae5e-2a5c802a0728`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:02:18,401::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [66f05af2] >Thread-32::DEBUG::2014-08-12 15:02:18,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f68ce52-f539-4eb5-8cd8-332767617144`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:02:18,401::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:02:18,402::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`391ddcd7-093f-42be-96db-e73eaa9347d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:02:18,402::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:02:18,402::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:02:18,403::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`391ddcd7-093f-42be-96db-e73eaa9347d2`::Granted request >Thread-32::DEBUG::2014-08-12 15:02:18,403::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0f68ce52-f539-4eb5-8cd8-332767617144`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:02:18,403::task::993::Storage.TaskManager.Task::(_decref) Task=`0f68ce52-f539-4eb5-8cd8-332767617144`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:02:18,415::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:18,416::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f68ce52-f539-4eb5-8cd8-332767617144`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:18,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f68ce52-f539-4eb5-8cd8-332767617144`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:02:18,416::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:02:18,416::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:02:18,416::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:02:18,417::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:02:18,417::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:02:18,417::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:02:18,417::task::993::Storage.TaskManager.Task::(_decref) Task=`0f68ce52-f539-4eb5-8cd8-332767617144`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:02:18,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:18,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131522 s, 77.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:20,213::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:20,214::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:20,228::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:20,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:20,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130484 s, 78.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:21,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5ce087a-8251-4c77-ad8b-bff909c490a3`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:21,797::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:02:21,798::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697438', 'lastCheck': '8.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811245', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:02:21,798::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5ce087a-8251-4c77-ad8b-bff909c490a3`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697438', 'lastCheck': '8.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811245', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:02:21,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5ce087a-8251-4c77-ad8b-bff909c490a3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:21,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:21,798::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:21,798::task::993::Storage.TaskManager.Task::(_decref) Task=`f5ce087a-8251-4c77-ad8b-bff909c490a3`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:02:21,855::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:22,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:22,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132065 s, 77.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:02:23,169::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-16::DEBUG::2014-08-12 15:02:23,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:02:23,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749406 s, 5.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:02:23,641::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:02:23,641::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:23,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:23,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:23,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:23,642::__init__::225::IOProcess::(_processLogs) (14276) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:23,642::__init__::225::IOProcess::(_processLogs) (14276) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:23,642::__init__::225::IOProcess::(_processLogs) (14276) Building response >Thread-25::DEBUG::2014-08-12 15:02:23,642::__init__::225::IOProcess::(_processLogs) (14276) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:23,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:23,643::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:02:23,644::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:02:23,644::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:02:23,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:23,644::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:23,644::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:23,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:23,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:23,645::__init__::225::IOProcess::(_processLogs) (14277) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:23,645::__init__::225::IOProcess::(_processLogs) (14277) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:23,645::__init__::225::IOProcess::(_processLogs) (14277) Building response >Thread-25::DEBUG::2014-08-12 15:02:23,645::__init__::225::IOProcess::(_processLogs) (14277) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:23,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:23,646::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:02:24,694::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:24,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-33::DEBUG::2014-08-12 15:02:24,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658504 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:02:24,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129111 s, 79.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:25,234::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:25,235::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:25,257::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:26,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:26,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130392 s, 78.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:28,442::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [78ec6cc5] >Thread-14::DEBUG::2014-08-12 15:02:28,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`5eeb629c-a67f-4d74-913c-22ba839369ad`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:28,443::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:02:28,482::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:28,483::task::1191::Storage.TaskManager.Task::(prepare) Task=`5eeb629c-a67f-4d74-913c-22ba839369ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:28,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`5eeb629c-a67f-4d74-913c-22ba839369ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:28,483::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:28,483::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:28,483::task::993::Storage.TaskManager.Task::(_decref) Task=`5eeb629c-a67f-4d74-913c-22ba839369ad`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:02:28,718::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [78ec6cc5] >Thread-32::DEBUG::2014-08-12 15:02:28,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`9be4880e-997d-4ebf-b088-d240dbeec33a`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:02:28,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:02:28,719::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d2d8a279-8d88-4254-8aea-3c59934ab33d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:02:28,719::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:02:28,719::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:02:28,719::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d2d8a279-8d88-4254-8aea-3c59934ab33d`::Granted request >Thread-32::DEBUG::2014-08-12 15:02:28,720::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9be4880e-997d-4ebf-b088-d240dbeec33a`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:02:28,720::task::993::Storage.TaskManager.Task::(_decref) Task=`9be4880e-997d-4ebf-b088-d240dbeec33a`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:02:28,732::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:28,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`9be4880e-997d-4ebf-b088-d240dbeec33a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:28,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`9be4880e-997d-4ebf-b088-d240dbeec33a`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:02:28,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:02:28,733::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:02:28,733::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:02:28,734::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:02:28,734::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:02:28,734::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:02:28,734::task::993::Storage.TaskManager.Task::(_decref) Task=`9be4880e-997d-4ebf-b088-d240dbeec33a`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:02:28,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:28,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147094 s, 69.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:30,264::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:30,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:30,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:30,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:30,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128863 s, 79.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:02:33,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:33,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130753 s, 78.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:02:33,647::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:02:33,658::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701315 s, 5.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:02:33,662::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:02:33,662::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:02:33,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:33,662::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:33,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:33,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:33,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:33,663::__init__::225::IOProcess::(_processLogs) (14278) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:33,663::__init__::225::IOProcess::(_processLogs) (14278) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:33,663::__init__::225::IOProcess::(_processLogs) (14278) Building response >Thread-25::DEBUG::2014-08-12 15:02:33,663::__init__::225::IOProcess::(_processLogs) (14278) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:33,663::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:33,664::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:02:33,664::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:02:33,665::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:02:33,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:33,665::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:33,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:33,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:33,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:33,666::__init__::225::IOProcess::(_processLogs) (14279) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:33,666::__init__::225::IOProcess::(_processLogs) (14279) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:33,666::__init__::225::IOProcess::(_processLogs) (14279) Building response >Thread-25::DEBUG::2014-08-12 15:02:33,666::__init__::225::IOProcess::(_processLogs) (14279) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:33,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:33,666::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:02:34,720::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:02:34,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062745 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:02:35,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:35,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012676 s, 80.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:35,282::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:35,287::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:35,288::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:37,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:37,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133743 s, 76.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:37,227::task::595::Storage.TaskManager.Task::(_updateState) Task=`b51b5d23-5c28-4f9a-884b-47db4dbe8e04`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:37,229::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:02:37,230::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701315', 'lastCheck': '3.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062745', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:02:37,231::task::1191::Storage.TaskManager.Task::(prepare) Task=`b51b5d23-5c28-4f9a-884b-47db4dbe8e04`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701315', 'lastCheck': '3.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062745', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:02:37,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`b51b5d23-5c28-4f9a-884b-47db4dbe8e04`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:37,233::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:37,234::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:37,235::task::993::Storage.TaskManager.Task::(_decref) Task=`b51b5d23-5c28-4f9a-884b-47db4dbe8e04`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:02:37,326::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:02:38,765::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:02:38,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`7959d984-5f77-492a-9a16-7b374438c831`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:38,766::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:02:38,778::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:38,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`7959d984-5f77-492a-9a16-7b374438c831`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:38,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`7959d984-5f77-492a-9a16-7b374438c831`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:38,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:38,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:38,779::task::993::Storage.TaskManager.Task::(_decref) Task=`7959d984-5f77-492a-9a16-7b374438c831`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:02:38,789::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:02:38,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`886e6c58-0892-43de-9217-2fa7e5c7aa42`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:02:38,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:02:38,791::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8f200d36-0dc6-4ba9-85a1-82d1b007fff1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:02:38,791::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:02:38,791::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:02:38,791::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8f200d36-0dc6-4ba9-85a1-82d1b007fff1`::Granted request >Thread-32::DEBUG::2014-08-12 15:02:38,792::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`886e6c58-0892-43de-9217-2fa7e5c7aa42`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:02:38,792::task::993::Storage.TaskManager.Task::(_decref) Task=`886e6c58-0892-43de-9217-2fa7e5c7aa42`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:02:38,804::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:38,804::task::1191::Storage.TaskManager.Task::(prepare) Task=`886e6c58-0892-43de-9217-2fa7e5c7aa42`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:38,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`886e6c58-0892-43de-9217-2fa7e5c7aa42`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:02:38,805::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:02:38,805::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:02:38,805::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:02:38,805::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:02:38,805::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:02:38,806::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:02:38,806::task::993::Storage.TaskManager.Task::(_decref) Task=`886e6c58-0892-43de-9217-2fa7e5c7aa42`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:02:39,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:39,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132983 s, 77.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:40,295::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:40,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:40,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:41,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:41,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137578 s, 74.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:02:43,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:43,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136151 s, 75.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:02:43,668::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:02:43,679::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625766 s, 6.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:02:43,682::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:02:43,682::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:02:43,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:43,683::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:43,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:43,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:43,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:43,683::__init__::225::IOProcess::(_processLogs) (14280) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:43,684::__init__::225::IOProcess::(_processLogs) (14280) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:43,684::__init__::225::IOProcess::(_processLogs) (14280) Building response >Thread-25::DEBUG::2014-08-12 15:02:43,684::__init__::225::IOProcess::(_processLogs) (14280) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:43,684::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:43,684::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:02:43,685::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:02:43,685::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:02:43,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:43,686::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:43,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:43,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:43,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:43,686::__init__::225::IOProcess::(_processLogs) (14281) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:43,686::__init__::225::IOProcess::(_processLogs) (14281) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:43,687::__init__::225::IOProcess::(_processLogs) (14281) Building response >Thread-25::DEBUG::2014-08-12 15:02:43,687::__init__::225::IOProcess::(_processLogs) (14281) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:43,687::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:43,687::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:02:44,733::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:02:44,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648167 s, 6.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:45,308::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:45,309::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:45,316::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:45,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:45,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121021 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:02:47,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:47,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135757 s, 75.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:48,823::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:02:48,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`83fcf6a5-f8b4-4571-922a-2e0780d55ed8`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:48,824::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:02:48,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:48,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`83fcf6a5-f8b4-4571-922a-2e0780d55ed8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:48,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`83fcf6a5-f8b4-4571-922a-2e0780d55ed8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:48,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:48,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:48,856::task::993::Storage.TaskManager.Task::(_decref) Task=`83fcf6a5-f8b4-4571-922a-2e0780d55ed8`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:02:48,868::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:02:48,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`b61fdb95-5735-4b15-9c72-4118ed58b70e`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:02:48,868::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:02:48,869::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c7f50377-5791-4515-a3db-fb1f79b3cb9f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:02:48,869::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:02:48,869::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:02:48,870::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c7f50377-5791-4515-a3db-fb1f79b3cb9f`::Granted request >Thread-32::DEBUG::2014-08-12 15:02:48,870::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b61fdb95-5735-4b15-9c72-4118ed58b70e`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:02:48,870::task::993::Storage.TaskManager.Task::(_decref) Task=`b61fdb95-5735-4b15-9c72-4118ed58b70e`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:02:48,882::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:48,883::task::1191::Storage.TaskManager.Task::(prepare) Task=`b61fdb95-5735-4b15-9c72-4118ed58b70e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:48,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`b61fdb95-5735-4b15-9c72-4118ed58b70e`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:02:48,883::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:02:48,883::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:02:48,883::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:02:48,884::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:02:48,884::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:02:48,884::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:02:48,884::task::993::Storage.TaskManager.Task::(_decref) Task=`b61fdb95-5735-4b15-9c72-4118ed58b70e`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:02:49,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`56b3913f-4363-4abc-98e4-0c2852fe8479`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:02:49,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:02:49,514::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:02:49,514::task::1191::Storage.TaskManager.Task::(prepare) Task=`56b3913f-4363-4abc-98e4-0c2852fe8479`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:02:49,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`56b3913f-4363-4abc-98e4-0c2852fe8479`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:02:49,515::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:02:49,515::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:02:49,515::task::993::Storage.TaskManager.Task::(_decref) Task=`56b3913f-4363-4abc-98e4-0c2852fe8479`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:02:49,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`b092c8b3-8601-4353-842e-717a81562420`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:02:49,515::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:02:49,516::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:02:49,516::task::1191::Storage.TaskManager.Task::(prepare) Task=`b092c8b3-8601-4353-842e-717a81562420`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:02:49,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`b092c8b3-8601-4353-842e-717a81562420`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:02:49,516::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:02:49,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:02:49,516::task::993::Storage.TaskManager.Task::(_decref) Task=`b092c8b3-8601-4353-842e-717a81562420`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:02:49,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4e3e144-3378-4bec-ab7c-8c9804af944c`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:02:49,517::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:02:49,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:02:49,517::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4e3e144-3378-4bec-ab7c-8c9804af944c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:02:49,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4e3e144-3378-4bec-ab7c-8c9804af944c`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:02:49,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:02:49,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:02:49,518::task::993::Storage.TaskManager.Task::(_decref) Task=`e4e3e144-3378-4bec-ab7c-8c9804af944c`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:02:49,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`92121602-80b4-4207-8cef-a9acab986510`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:02:49,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:02:49,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:02:49,519::task::1191::Storage.TaskManager.Task::(prepare) Task=`92121602-80b4-4207-8cef-a9acab986510`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:02:49,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`92121602-80b4-4207-8cef-a9acab986510`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:02:49,519::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:02:49,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:02:49,519::task::993::Storage.TaskManager.Task::(_decref) Task=`92121602-80b4-4207-8cef-a9acab986510`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:02:49,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:49,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134259 s, 76.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:50,323::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:50,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:50,328::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:51,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:51,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130299 s, 78.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:52,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c9d4060-aa41-403e-baf8-078b00056ec8`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:52,484::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:02:52,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625766', 'lastCheck': '8.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648167', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:02:52,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c9d4060-aa41-403e-baf8-078b00056ec8`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625766', 'lastCheck': '8.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648167', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:02:52,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c9d4060-aa41-403e-baf8-078b00056ec8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:52,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:52,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:52,485::task::993::Storage.TaskManager.Task::(_decref) Task=`3c9d4060-aa41-403e-baf8-078b00056ec8`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:02:52,543::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:02:53,239::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-16::DEBUG::2014-08-12 15:02:53,689::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:02:53,700::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753464 s, 5.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:02:53,703::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:02:53,703::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:02:53,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:53,704::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:53,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:53,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:53,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:53,704::__init__::225::IOProcess::(_processLogs) (14282) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:53,705::__init__::225::IOProcess::(_processLogs) (14282) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:53,705::__init__::225::IOProcess::(_processLogs) (14282) Building response >Thread-25::DEBUG::2014-08-12 15:02:53,705::__init__::225::IOProcess::(_processLogs) (14282) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:53,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:53,705::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:02:53,706::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:02:53,707::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:02:53,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:02:53,707::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:02:53,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:02:53,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:02:53,707::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:02:53,708::__init__::225::IOProcess::(_processLogs) (14283) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:02:53,708::__init__::225::IOProcess::(_processLogs) (14283) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:02:53,708::__init__::225::IOProcess::(_processLogs) (14283) Building response >Thread-25::DEBUG::2014-08-12 15:02:53,708::__init__::225::IOProcess::(_processLogs) (14283) Queuing response >Thread-25::DEBUG::2014-08-12 15:02:53,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:02:53,708::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:02:53,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:53,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130831 s, 78.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:02:54,746::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:02:54,758::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678147 s, 6.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:55,334::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:55,335::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:02:55,351::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:02:55,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:55,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131524 s, 77.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:02:57,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:02:57,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129758 s, 78.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:02:58,900::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:02:58,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`39b3fb52-482e-4f7c-8739-e06829c31cc4`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:02:58,901::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:02:58,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:58,913::task::1191::Storage.TaskManager.Task::(prepare) Task=`39b3fb52-482e-4f7c-8739-e06829c31cc4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:02:58,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`39b3fb52-482e-4f7c-8739-e06829c31cc4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:02:58,913::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:02:58,914::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:02:58,914::task::993::Storage.TaskManager.Task::(_decref) Task=`39b3fb52-482e-4f7c-8739-e06829c31cc4`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:02:58,930::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:02:58,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a8b7ced-81f1-4995-a387-02e063e0d293`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:02:58,930::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:02:58,931::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`aaea1a49-848f-4ffa-b32e-187e9002fcda`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:02:58,931::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:02:58,931::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:02:58,931::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`aaea1a49-848f-4ffa-b32e-187e9002fcda`::Granted request >Thread-32::DEBUG::2014-08-12 15:02:58,932::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5a8b7ced-81f1-4995-a387-02e063e0d293`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:02:58,932::task::993::Storage.TaskManager.Task::(_decref) Task=`5a8b7ced-81f1-4995-a387-02e063e0d293`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:02:58,944::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:58,944::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a8b7ced-81f1-4995-a387-02e063e0d293`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:02:58,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a8b7ced-81f1-4995-a387-02e063e0d293`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:02:58,945::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:02:58,945::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:02:58,945::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:02:58,945::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:02:58,946::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:02:58,946::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:02:58,946::task::993::Storage.TaskManager.Task::(_decref) Task=`5a8b7ced-81f1-4995-a387-02e063e0d293`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:03:00,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:00,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130887 s, 78.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:00,358::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:00,359::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:00,368::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:02,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:02,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129779 s, 78.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:03:03,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:03:03,721::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735835 s, 5.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:03:03,724::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:03,724::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:03:03,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:03,725::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:03,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:03,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:03,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:03,725::__init__::225::IOProcess::(_processLogs) (14284) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:03,726::__init__::225::IOProcess::(_processLogs) (14284) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:03,726::__init__::225::IOProcess::(_processLogs) (14284) Building response >Thread-25::DEBUG::2014-08-12 15:03:03,726::__init__::225::IOProcess::(_processLogs) (14284) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:03,726::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:03,726::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:03:03,727::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:03,727::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:03:03,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:03,728::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:03,728::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:03,728::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:03,728::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:03,728::__init__::225::IOProcess::(_processLogs) (14285) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:03,728::__init__::225::IOProcess::(_processLogs) (14285) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:03,729::__init__::225::IOProcess::(_processLogs) (14285) Building response >Thread-25::DEBUG::2014-08-12 15:03:03,729::__init__::225::IOProcess::(_processLogs) (14285) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:03,729::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:03,729::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:03:04,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:04,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130623 s, 78.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:03:04,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:03:04,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696807 s, 5.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:05,375::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:05,376::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:05,392::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:06,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:06,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136059 s, 75.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:07,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`0182131c-141d-46a8-b78e-47b82185c07e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:07,661::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:03:07,661::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735835', 'lastCheck': '3.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696807', 'lastCheck': '2.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:03:07,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`0182131c-141d-46a8-b78e-47b82185c07e`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735835', 'lastCheck': '3.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696807', 'lastCheck': '2.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:03:07,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`0182131c-141d-46a8-b78e-47b82185c07e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:07,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:07,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:07,662::task::993::Storage.TaskManager.Task::(_decref) Task=`0182131c-141d-46a8-b78e-47b82185c07e`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:03:07,684::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:08,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:08,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132109 s, 77.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:08,965::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:03:08,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`958a64d3-e8c3-4219-98db-c3422d4f05b7`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:08,966::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:03:08,999::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:08,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`958a64d3-e8c3-4219-98db-c3422d4f05b7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:08,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`958a64d3-e8c3-4219-98db-c3422d4f05b7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:09,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:09,000::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:09,000::task::993::Storage.TaskManager.Task::(_decref) Task=`958a64d3-e8c3-4219-98db-c3422d4f05b7`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:03:09,013::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:03:09,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`58e1845a-9bfb-401e-b9c7-95b5da058cf7`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:03:09,014::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:03:09,014::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`5977b10b-a6c6-46d6-9410-1034da108d49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:03:09,015::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:03:09,015::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:03:09,015::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`5977b10b-a6c6-46d6-9410-1034da108d49`::Granted request >Thread-32::DEBUG::2014-08-12 15:03:09,015::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`58e1845a-9bfb-401e-b9c7-95b5da058cf7`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:03:09,016::task::993::Storage.TaskManager.Task::(_decref) Task=`58e1845a-9bfb-401e-b9c7-95b5da058cf7`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:03:09,028::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:09,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`58e1845a-9bfb-401e-b9c7-95b5da058cf7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:09,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`58e1845a-9bfb-401e-b9c7-95b5da058cf7`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:03:09,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:03:09,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:03:09,029::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:03:09,030::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:03:09,030::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:03:09,030::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:03:09,030::task::993::Storage.TaskManager.Task::(_decref) Task=`58e1845a-9bfb-401e-b9c7-95b5da058cf7`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:03:10,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:10,402::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:10,408::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:10,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0232407 s, 44.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:10,450::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:12,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:12,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141214 s, 72.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:03:13,730::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:03:13,742::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672143 s, 6.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:03:13,751::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:13,751::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:03:13,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:13,751::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:13,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:13,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:13,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:13,752::__init__::225::IOProcess::(_processLogs) (14286) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:13,752::__init__::225::IOProcess::(_processLogs) (14286) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:13,752::__init__::225::IOProcess::(_processLogs) (14286) Building response >Thread-25::DEBUG::2014-08-12 15:03:13,752::__init__::225::IOProcess::(_processLogs) (14286) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:13,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:13,753::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:03:13,753::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:13,754::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:03:13,754::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:13,754::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:13,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:13,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:13,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:13,755::__init__::225::IOProcess::(_processLogs) (14287) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:13,755::__init__::225::IOProcess::(_processLogs) (14287) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:13,755::__init__::225::IOProcess::(_processLogs) (14287) Building response >Thread-25::DEBUG::2014-08-12 15:03:13,755::__init__::225::IOProcess::(_processLogs) (14287) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:13,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:13,756::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:03:14,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:14,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131597 s, 77.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:03:14,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:03:14,785::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637954 s, 6.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:15,459::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:15,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:15,469::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:16,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:16,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0210853 s, 48.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:03:18,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:18,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121119 s, 84.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:19,046::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:03:19,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`35533ec1-7f07-4d86-9dc8-2122e2c2ff5d`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:19,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:03:19,081::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:19,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`35533ec1-7f07-4d86-9dc8-2122e2c2ff5d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:19,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`35533ec1-7f07-4d86-9dc8-2122e2c2ff5d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:19,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:19,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:19,082::task::993::Storage.TaskManager.Task::(_decref) Task=`35533ec1-7f07-4d86-9dc8-2122e2c2ff5d`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:03:19,094::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:03:19,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2c64cf1-3f67-49e0-9852-7df9323e3ec2`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:03:19,094::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:03:19,095::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`7c4b90c1-5481-4048-b9e7-69da19c84b4f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:03:19,095::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:03:19,095::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:03:19,096::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`7c4b90c1-5481-4048-b9e7-69da19c84b4f`::Granted request >Thread-32::DEBUG::2014-08-12 15:03:19,096::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b2c64cf1-3f67-49e0-9852-7df9323e3ec2`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:03:19,096::task::993::Storage.TaskManager.Task::(_decref) Task=`b2c64cf1-3f67-49e0-9852-7df9323e3ec2`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:03:19,109::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:19,109::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2c64cf1-3f67-49e0-9852-7df9323e3ec2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:19,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2c64cf1-3f67-49e0-9852-7df9323e3ec2`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:03:19,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:03:19,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:03:19,110::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:03:19,110::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:03:19,110::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:03:19,110::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:03:19,111::task::993::Storage.TaskManager.Task::(_decref) Task=`b2c64cf1-3f67-49e0-9852-7df9323e3ec2`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:20,475::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:20,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:20,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:20,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:20,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0140122 s, 73.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:22,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`da9118dd-069b-4c7f-99c0-fe5e3a2703cc`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:22,793::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:03:22,793::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672143', 'lastCheck': '9.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637954', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:03:22,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`da9118dd-069b-4c7f-99c0-fe5e3a2703cc`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672143', 'lastCheck': '9.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637954', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:03:22,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`da9118dd-069b-4c7f-99c0-fe5e3a2703cc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:22,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:22,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:22,794::task::993::Storage.TaskManager.Task::(_decref) Task=`da9118dd-069b-4c7f-99c0-fe5e3a2703cc`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:03:22,815::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:22,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:22,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122649 s, 83.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:03:23,311::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-16::DEBUG::2014-08-12 15:03:23,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:03:23,768::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719607 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:03:23,771::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:23,771::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:03:23,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:23,771::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:23,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:23,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:23,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:23,772::__init__::225::IOProcess::(_processLogs) (14288) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:23,772::__init__::225::IOProcess::(_processLogs) (14288) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:23,772::__init__::225::IOProcess::(_processLogs) (14288) Building response >Thread-25::DEBUG::2014-08-12 15:03:23,773::__init__::225::IOProcess::(_processLogs) (14288) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:23,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:23,773::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:03:23,774::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:23,774::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:03:23,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:23,774::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:23,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:23,775::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:23,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:23,775::__init__::225::IOProcess::(_processLogs) (14289) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:23,775::__init__::225::IOProcess::(_processLogs) (14289) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:23,775::__init__::225::IOProcess::(_processLogs) (14289) Building response >Thread-25::DEBUG::2014-08-12 15:03:23,775::__init__::225::IOProcess::(_processLogs) (14289) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:23,775::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:23,776::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:03:24,787::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:03:24,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589119 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:03:24,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:25,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0149258 s, 68.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:25,493::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:25,494::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:25,510::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:27,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:27,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129501 s, 79.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:29,128::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:03:29,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b4d4834-9f95-4f9a-abb2-be8a4189cdf1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:29,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Dummy-31::DEBUG::2014-08-12 15:03:29,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::INFO::2014-08-12 15:03:29,193::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Dummy-31::DEBUG::2014-08-12 15:03:29,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121476 s, 84.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:29,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b4d4834-9f95-4f9a-abb2-be8a4189cdf1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:29,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b4d4834-9f95-4f9a-abb2-be8a4189cdf1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:29,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:29,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:29,206::task::993::Storage.TaskManager.Task::(_decref) Task=`4b4d4834-9f95-4f9a-abb2-be8a4189cdf1`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:03:29,229::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:03:29,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9b4acf7-e183-4c3b-b87d-a6ad4aceb239`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:03:29,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:03:29,234::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9f97561b-f7ce-4803-bfc9-210ba653b600`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:03:29,235::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:03:29,236::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:03:29,237::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9f97561b-f7ce-4803-bfc9-210ba653b600`::Granted request >Thread-32::DEBUG::2014-08-12 15:03:29,239::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f9b4acf7-e183-4c3b-b87d-a6ad4aceb239`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:03:29,240::task::993::Storage.TaskManager.Task::(_decref) Task=`f9b4acf7-e183-4c3b-b87d-a6ad4aceb239`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:03:29,254::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:29,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9b4acf7-e183-4c3b-b87d-a6ad4aceb239`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:29,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9b4acf7-e183-4c3b-b87d-a6ad4aceb239`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:03:29,255::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:03:29,255::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:03:29,255::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:03:29,256::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:03:29,256::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:03:29,256::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:03:29,256::task::993::Storage.TaskManager.Task::(_decref) Task=`f9b4acf7-e183-4c3b-b87d-a6ad4aceb239`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:30,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:30,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:30,528::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:31,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:31,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012122 s, 84.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:03:33,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:33,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128017 s, 80.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:03:33,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:03:33,788::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696229 s, 5.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:03:33,791::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:33,792::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:03:33,792::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:33,792::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:33,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:33,792::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:33,792::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:33,793::__init__::225::IOProcess::(_processLogs) (14290) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:33,793::__init__::225::IOProcess::(_processLogs) (14290) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:33,793::__init__::225::IOProcess::(_processLogs) (14290) Building response >Thread-25::DEBUG::2014-08-12 15:03:33,793::__init__::225::IOProcess::(_processLogs) (14290) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:33,793::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:33,793::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:03:33,794::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:33,794::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:03:33,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:33,795::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:33,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:33,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:33,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:33,795::__init__::225::IOProcess::(_processLogs) (14291) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:33,796::__init__::225::IOProcess::(_processLogs) (14291) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:33,796::__init__::225::IOProcess::(_processLogs) (14291) Building response >Thread-25::DEBUG::2014-08-12 15:03:33,796::__init__::225::IOProcess::(_processLogs) (14291) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:33,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:33,796::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:03:34,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:03:34,812::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741591 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:03:35,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:35,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120565 s, 84.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:35,534::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:35,535::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:35,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:37,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:37,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119219 s, 85.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:37,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4d87f58-d1b1-4109-abfa-cfde7d9ab2af`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:37,908::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:03:37,915::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696229', 'lastCheck': '4.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741591', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:03:37,915::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4d87f58-d1b1-4109-abfa-cfde7d9ab2af`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696229', 'lastCheck': '4.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741591', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:03:37,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4d87f58-d1b1-4109-abfa-cfde7d9ab2af`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:37,916::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:37,916::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:37,916::task::993::Storage.TaskManager.Task::(_decref) Task=`f4d87f58-d1b1-4109-abfa-cfde7d9ab2af`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:03:37,938::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:03:39,275::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:03:39,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa3617e1-440c-483d-b185-9e1a894186a1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:39,276::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:03:39,309::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:39,309::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa3617e1-440c-483d-b185-9e1a894186a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:39,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa3617e1-440c-483d-b185-9e1a894186a1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:39,309::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:39,309::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:39,310::task::993::Storage.TaskManager.Task::(_decref) Task=`fa3617e1-440c-483d-b185-9e1a894186a1`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:03:39,321::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:03:39,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`5df0c6a5-cd4e-4055-b687-d37350dbf78d`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:03:39,322::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:03:39,322::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c0ec2c7a-f30e-4833-9f7e-643ca3ceecf4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:03:39,323::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:03:39,323::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:03:39,323::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c0ec2c7a-f30e-4833-9f7e-643ca3ceecf4`::Granted request >Thread-32::DEBUG::2014-08-12 15:03:39,323::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5df0c6a5-cd4e-4055-b687-d37350dbf78d`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:03:39,324::task::993::Storage.TaskManager.Task::(_decref) Task=`5df0c6a5-cd4e-4055-b687-d37350dbf78d`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:03:39,336::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:39,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`5df0c6a5-cd4e-4055-b687-d37350dbf78d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:39,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`5df0c6a5-cd4e-4055-b687-d37350dbf78d`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:03:39,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:03:39,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:03:39,337::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:03:39,337::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:03:39,337::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:03:39,337::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:03:39,338::task::993::Storage.TaskManager.Task::(_decref) Task=`5df0c6a5-cd4e-4055-b687-d37350dbf78d`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:03:39,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:39,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119132 s, 86.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:40,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:40,565::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:40,575::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:41,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:41,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016578 s, 61.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:03:43,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:43,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119691 s, 85.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:03:43,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:03:43,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649444 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:03:43,815::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:43,815::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:03:43,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:43,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:43,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:43,815::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:43,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:43,816::__init__::225::IOProcess::(_processLogs) (14292) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:43,816::__init__::225::IOProcess::(_processLogs) (14292) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:43,816::__init__::225::IOProcess::(_processLogs) (14292) Building response >Thread-25::DEBUG::2014-08-12 15:03:43,816::__init__::225::IOProcess::(_processLogs) (14292) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:43,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:43,817::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:03:43,817::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:43,818::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:03:43,818::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:43,818::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:43,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:43,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:43,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:43,818::__init__::225::IOProcess::(_processLogs) (14293) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:43,819::__init__::225::IOProcess::(_processLogs) (14293) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:43,819::__init__::225::IOProcess::(_processLogs) (14293) Building response >Thread-25::DEBUG::2014-08-12 15:03:43,819::__init__::225::IOProcess::(_processLogs) (14293) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:43,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:43,819::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:03:44,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:03:44,828::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606492 s, 6.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:45,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:45,583::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:45,587::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:45,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:45,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121598 s, 84.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:03:47,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:47,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118753 s, 86.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:49,353::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:03:49,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dd79cdb-e8a9-42cb-97d5-5f605c07d4ec`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:49,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:03:49,385::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:49,386::task::1191::Storage.TaskManager.Task::(prepare) Task=`7dd79cdb-e8a9-42cb-97d5-5f605c07d4ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:49,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dd79cdb-e8a9-42cb-97d5-5f605c07d4ec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:49,386::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:49,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:49,386::task::993::Storage.TaskManager.Task::(_decref) Task=`7dd79cdb-e8a9-42cb-97d5-5f605c07d4ec`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:03:49,398::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:03:49,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`af6b2037-5639-4a19-93ed-20950178eb66`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:03:49,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:03:49,399::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`413e63d2-70c4-4fc9-ba53-9ce4791e0082`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:03:49,399::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:03:49,399::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:03:49,400::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`413e63d2-70c4-4fc9-ba53-9ce4791e0082`::Granted request >Thread-32::DEBUG::2014-08-12 15:03:49,400::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af6b2037-5639-4a19-93ed-20950178eb66`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:03:49,400::task::993::Storage.TaskManager.Task::(_decref) Task=`af6b2037-5639-4a19-93ed-20950178eb66`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:03:49,414::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:49,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`af6b2037-5639-4a19-93ed-20950178eb66`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:49,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`af6b2037-5639-4a19-93ed-20950178eb66`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:03:49,415::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:03:49,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:03:49,415::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:03:49,415::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:03:49,415::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:03:49,415::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:03:49,416::task::993::Storage.TaskManager.Task::(_decref) Task=`af6b2037-5639-4a19-93ed-20950178eb66`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:03:49,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:49,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128976 s, 79.4 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:03:50,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e34d33a-8bd6-44af-b999-ecf058f08bf4`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:03:50,420::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:03:50,421::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:03:50,421::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e34d33a-8bd6-44af-b999-ecf058f08bf4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:03:50,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e34d33a-8bd6-44af-b999-ecf058f08bf4`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:03:50,421::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:03:50,421::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:03:50,421::task::993::Storage.TaskManager.Task::(_decref) Task=`6e34d33a-8bd6-44af-b999-ecf058f08bf4`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:03:50,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`d304fd8b-b393-46f4-80f8-ffe0fa23a73b`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:03:50,422::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:03:50,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:03:50,422::task::1191::Storage.TaskManager.Task::(prepare) Task=`d304fd8b-b393-46f4-80f8-ffe0fa23a73b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:03:50,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`d304fd8b-b393-46f4-80f8-ffe0fa23a73b`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:03:50,423::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:03:50,423::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:03:50,423::task::993::Storage.TaskManager.Task::(_decref) Task=`d304fd8b-b393-46f4-80f8-ffe0fa23a73b`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:03:50,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`da514a63-e2d6-42ed-aece-e6f3b07a295d`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:03:50,423::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:03:50,424::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:03:50,424::task::1191::Storage.TaskManager.Task::(prepare) Task=`da514a63-e2d6-42ed-aece-e6f3b07a295d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:03:50,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`da514a63-e2d6-42ed-aece-e6f3b07a295d`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:03:50,424::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:03:50,424::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:03:50,424::task::993::Storage.TaskManager.Task::(_decref) Task=`da514a63-e2d6-42ed-aece-e6f3b07a295d`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:03:50,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`bef6b83c-c15b-4991-b9f5-dd93f34024d8`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:03:50,425::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:03:50,425::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:03:50,425::task::1191::Storage.TaskManager.Task::(prepare) Task=`bef6b83c-c15b-4991-b9f5-dd93f34024d8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:03:50,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`bef6b83c-c15b-4991-b9f5-dd93f34024d8`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:03:50,426::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:03:50,426::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:03:50,426::task::993::Storage.TaskManager.Task::(_decref) Task=`bef6b83c-c15b-4991-b9f5-dd93f34024d8`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:50,593::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:50,594::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:50,594::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:51,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:52,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128522 s, 79.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:53,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`5476cb69-1ad6-4d2d-9633-e7c6ab3f91fd`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:53,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:03:53,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649444', 'lastCheck': '9.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606492', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:03:53,043::task::1191::Storage.TaskManager.Task::(prepare) Task=`5476cb69-1ad6-4d2d-9633-e7c6ab3f91fd`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649444', 'lastCheck': '9.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606492', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:03:53,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`5476cb69-1ad6-4d2d-9633-e7c6ab3f91fd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:53,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:53,044::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:53,044::task::993::Storage.TaskManager.Task::(_decref) Task=`5476cb69-1ad6-4d2d-9633-e7c6ab3f91fd`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:03:53,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:03:53,354::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-16::DEBUG::2014-08-12 15:03:53,821::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:03:53,833::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000848386 s, 4.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:03:53,837::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:53,837::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:03:53,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:53,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:53,838::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:53,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:53,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:53,838::__init__::225::IOProcess::(_processLogs) (14294) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:53,839::__init__::225::IOProcess::(_processLogs) (14294) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:53,839::__init__::225::IOProcess::(_processLogs) (14294) Building response >Thread-25::DEBUG::2014-08-12 15:03:53,839::__init__::225::IOProcess::(_processLogs) (14294) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:53,839::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:53,839::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:03:53,840::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:03:53,840::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:03:53,841::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:03:53,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:03:53,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:03:53,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:03:53,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:03:53,841::__init__::225::IOProcess::(_processLogs) (14295) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:03:53,841::__init__::225::IOProcess::(_processLogs) (14295) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:03:53,842::__init__::225::IOProcess::(_processLogs) (14295) Building response >Thread-25::DEBUG::2014-08-12 15:03:53,842::__init__::225::IOProcess::(_processLogs) (14295) Queuing response >Thread-25::DEBUG::2014-08-12 15:03:53,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:03:53,842::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:03:54,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:54,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130959 s, 78.2 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:03:54,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:03:54,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061864 s, 6.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:55,601::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:55,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:03:55,603::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:03:56,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:56,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131865 s, 77.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:03:58,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:03:58,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124452 s, 82.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:03:59,436::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:03:59,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e534bd8-2ee6-4fb4-9f28-4830fff092b5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:03:59,437::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:03:59,449::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:59,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e534bd8-2ee6-4fb4-9f28-4830fff092b5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:03:59,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e534bd8-2ee6-4fb4-9f28-4830fff092b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:03:59,449::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:03:59,449::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:03:59,450::task::993::Storage.TaskManager.Task::(_decref) Task=`8e534bd8-2ee6-4fb4-9f28-4830fff092b5`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:03:59,468::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:03:59,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`60f2a909-e00e-40e3-a61a-17ce143e7b3e`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:03:59,468::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:03:59,469::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2f6670bd-3fe6-4892-a78a-b74738ff396d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:03:59,469::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:03:59,469::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:03:59,470::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2f6670bd-3fe6-4892-a78a-b74738ff396d`::Granted request >Thread-32::DEBUG::2014-08-12 15:03:59,470::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`60f2a909-e00e-40e3-a61a-17ce143e7b3e`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:03:59,470::task::993::Storage.TaskManager.Task::(_decref) Task=`60f2a909-e00e-40e3-a61a-17ce143e7b3e`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:03:59,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:59,489::task::1191::Storage.TaskManager.Task::(prepare) Task=`60f2a909-e00e-40e3-a61a-17ce143e7b3e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:03:59,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`60f2a909-e00e-40e3-a61a-17ce143e7b3e`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:03:59,489::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:03:59,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:03:59,490::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:03:59,490::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:03:59,490::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:03:59,490::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:03:59,490::task::993::Storage.TaskManager.Task::(_decref) Task=`60f2a909-e00e-40e3-a61a-17ce143e7b3e`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:04:00,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:00,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123236 s, 83.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:00,610::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:00,611::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:00,614::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:02,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:02,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121259 s, 84.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:04:03,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:03,854::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074411 s, 5.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:04:03,858::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:03,858::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:04:03,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:03,858::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:03,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:03,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:03,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:03,859::__init__::225::IOProcess::(_processLogs) (14296) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:03,859::__init__::225::IOProcess::(_processLogs) (14296) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:03,859::__init__::225::IOProcess::(_processLogs) (14296) Building response >Thread-25::DEBUG::2014-08-12 15:04:03,859::__init__::225::IOProcess::(_processLogs) (14296) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:03,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:03,860::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:04:03,860::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:03,861::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:04:03,861::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:03,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:03,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:03,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:03,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:03,862::__init__::225::IOProcess::(_processLogs) (14297) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:03,862::__init__::225::IOProcess::(_processLogs) (14297) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:03,862::__init__::225::IOProcess::(_processLogs) (14297) Building response >Thread-25::DEBUG::2014-08-12 15:04:03,862::__init__::225::IOProcess::(_processLogs) (14297) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:03,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:03,862::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:04:04,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:04,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120554 s, 84.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:04:04,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:04:04,856::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695614 s, 5.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:05,621::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:05,622::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:05,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:06,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:06,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121915 s, 84.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:08,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`79e1b8cf-760d-4343-8d6a-6d94f068b0e2`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:08,166::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:04:08,166::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074411', 'lastCheck': '4.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695614', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:04:08,166::task::1191::Storage.TaskManager.Task::(prepare) Task=`79e1b8cf-760d-4343-8d6a-6d94f068b0e2`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074411', 'lastCheck': '4.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695614', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:04:08,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`79e1b8cf-760d-4343-8d6a-6d94f068b0e2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:08,167::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:08,167::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:08,167::task::993::Storage.TaskManager.Task::(_decref) Task=`79e1b8cf-760d-4343-8d6a-6d94f068b0e2`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:04:08,188::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:08,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:08,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130724 s, 78.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:09,505::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:04:09,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6a3f82b-7e0b-4c18-bde6-0e31ac77bf4e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:09,506::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:04:09,549::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:09,549::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6a3f82b-7e0b-4c18-bde6-0e31ac77bf4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:09,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6a3f82b-7e0b-4c18-bde6-0e31ac77bf4e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:09,549::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:09,549::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:09,550::task::993::Storage.TaskManager.Task::(_decref) Task=`a6a3f82b-7e0b-4c18-bde6-0e31ac77bf4e`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:04:09,561::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:04:09,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`af217662-b4c8-4248-8b44-ecb67eb72f3a`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:04:09,561::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:04:09,562::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ff2335e9-8a9e-437a-8123-a01e37d70622`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:04:09,562::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:04:09,562::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:04:09,562::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ff2335e9-8a9e-437a-8123-a01e37d70622`::Granted request >Thread-32::DEBUG::2014-08-12 15:04:09,563::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af217662-b4c8-4248-8b44-ecb67eb72f3a`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:04:09,563::task::993::Storage.TaskManager.Task::(_decref) Task=`af217662-b4c8-4248-8b44-ecb67eb72f3a`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:04:09,575::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:09,575::task::1191::Storage.TaskManager.Task::(prepare) Task=`af217662-b4c8-4248-8b44-ecb67eb72f3a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:09,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`af217662-b4c8-4248-8b44-ecb67eb72f3a`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:04:09,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:04:09,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:04:09,576::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:04:09,576::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:04:09,577::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:04:09,577::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:04:09,577::task::993::Storage.TaskManager.Task::(_decref) Task=`af217662-b4c8-4248-8b44-ecb67eb72f3a`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:04:10,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:10,642::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:10,643::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:10,644::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:10,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132161 s, 77.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:12,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:12,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126032 s, 81.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:04:13,864::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:13,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650844 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:04:13,878::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:13,879::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:04:13,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:13,879::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:13,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:13,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:13,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:13,880::__init__::225::IOProcess::(_processLogs) (14298) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:13,880::__init__::225::IOProcess::(_processLogs) (14298) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:13,880::__init__::225::IOProcess::(_processLogs) (14298) Building response >Thread-25::DEBUG::2014-08-12 15:04:13,880::__init__::225::IOProcess::(_processLogs) (14298) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:13,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:13,880::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:04:13,881::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:13,882::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:04:13,882::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:13,882::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:13,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:13,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:13,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:13,883::__init__::225::IOProcess::(_processLogs) (14299) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:13,883::__init__::225::IOProcess::(_processLogs) (14299) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:13,883::__init__::225::IOProcess::(_processLogs) (14299) Building response >Thread-25::DEBUG::2014-08-12 15:04:13,883::__init__::225::IOProcess::(_processLogs) (14299) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:13,883::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:13,883::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:04:14,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:14,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119214 s, 85.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:04:14,858::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:04:14,870::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614898 s, 6.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:15,646::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:15,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:15,655::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:16,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:16,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119091 s, 86.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:18,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:18,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012406 s, 82.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:19,592::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:04:19,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cadafa0-cca0-4d90-88d5-6e80e4e6899c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:19,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:04:19,609::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:19,609::task::1191::Storage.TaskManager.Task::(prepare) Task=`1cadafa0-cca0-4d90-88d5-6e80e4e6899c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:19,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cadafa0-cca0-4d90-88d5-6e80e4e6899c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:19,609::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:19,610::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:19,610::task::993::Storage.TaskManager.Task::(_decref) Task=`1cadafa0-cca0-4d90-88d5-6e80e4e6899c`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:04:19,621::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:04:19,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`b59b97dd-47f0-4162-9f90-355696bcbd5f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:04:19,621::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:04:19,624::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`6659657b-d92d-4f15-8f7e-20cf551fb6af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:04:19,624::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:04:19,624::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:04:19,624::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`6659657b-d92d-4f15-8f7e-20cf551fb6af`::Granted request >Thread-32::DEBUG::2014-08-12 15:04:19,625::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b59b97dd-47f0-4162-9f90-355696bcbd5f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:04:19,625::task::993::Storage.TaskManager.Task::(_decref) Task=`b59b97dd-47f0-4162-9f90-355696bcbd5f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:04:19,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:19,641::task::1191::Storage.TaskManager.Task::(prepare) Task=`b59b97dd-47f0-4162-9f90-355696bcbd5f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:19,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`b59b97dd-47f0-4162-9f90-355696bcbd5f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:04:19,641::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:04:19,641::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:04:19,642::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:04:19,642::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:04:19,642::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:04:19,642::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:04:19,642::task::993::Storage.TaskManager.Task::(_decref) Task=`b59b97dd-47f0-4162-9f90-355696bcbd5f`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:20,661::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:20,662::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:20,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:20,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:21,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121684 s, 84.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:23,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:23,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121828 s, 84.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:23,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1595682-e2fb-47b5-82f3-4c08a53eb637`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:23,280::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:04:23,280::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650844', 'lastCheck': '9.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614898', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:04:23,281::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1595682-e2fb-47b5-82f3-4c08a53eb637`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650844', 'lastCheck': '9.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614898', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:04:23,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1595682-e2fb-47b5-82f3-4c08a53eb637`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:23,281::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:23,281::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:23,281::task::993::Storage.TaskManager.Task::(_decref) Task=`e1595682-e2fb-47b5-82f3-4c08a53eb637`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:04:23,302::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:04:23,421::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-16::DEBUG::2014-08-12 15:04:23,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:23,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609031 s, 6.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:04:23,906::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:23,906::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:04:23,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:23,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:23,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:23,907::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:23,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:23,907::__init__::225::IOProcess::(_processLogs) (14300) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:23,907::__init__::225::IOProcess::(_processLogs) (14300) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:23,907::__init__::225::IOProcess::(_processLogs) (14300) Building response >Thread-25::DEBUG::2014-08-12 15:04:23,908::__init__::225::IOProcess::(_processLogs) (14300) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:23,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:23,908::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:04:23,909::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:23,909::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:04:23,909::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:23,909::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:23,909::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:23,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:23,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:23,910::__init__::225::IOProcess::(_processLogs) (14301) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:23,910::__init__::225::IOProcess::(_processLogs) (14301) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:23,910::__init__::225::IOProcess::(_processLogs) (14301) Building response >Thread-25::DEBUG::2014-08-12 15:04:23,910::__init__::225::IOProcess::(_processLogs) (14301) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:23,911::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:23,911::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:04:24,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:04:24,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628983 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:25,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:25,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120748 s, 84.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:25,673::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:25,674::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:25,696::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:27,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:27,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121075 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:29,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:29,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133171 s, 76.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:29,658::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5a88410a] >Thread-14::DEBUG::2014-08-12 15:04:29,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`53c35994-6f63-49fa-bfa2-6fff56e178dc`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:29,658::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:04:29,735::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:29,736::task::1191::Storage.TaskManager.Task::(prepare) Task=`53c35994-6f63-49fa-bfa2-6fff56e178dc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:29,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`53c35994-6f63-49fa-bfa2-6fff56e178dc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:29,736::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:29,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:29,736::task::993::Storage.TaskManager.Task::(_decref) Task=`53c35994-6f63-49fa-bfa2-6fff56e178dc`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:04:29,748::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5a88410a] >Thread-32::DEBUG::2014-08-12 15:04:29,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`f41ad09c-4620-4f24-8aaa-e98c88eec421`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:04:29,749::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:04:29,749::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`1d1ee50a-c6fc-46db-923c-d3041c624b8f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:04:29,750::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:04:29,750::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:04:29,750::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`1d1ee50a-c6fc-46db-923c-d3041c624b8f`::Granted request >Thread-32::DEBUG::2014-08-12 15:04:29,750::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f41ad09c-4620-4f24-8aaa-e98c88eec421`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:04:29,751::task::993::Storage.TaskManager.Task::(_decref) Task=`f41ad09c-4620-4f24-8aaa-e98c88eec421`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:04:29,763::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:29,763::task::1191::Storage.TaskManager.Task::(prepare) Task=`f41ad09c-4620-4f24-8aaa-e98c88eec421`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:29,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`f41ad09c-4620-4f24-8aaa-e98c88eec421`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:04:29,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:04:29,764::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:04:29,764::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:04:29,764::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:04:29,765::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:04:29,765::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:04:29,765::task::993::Storage.TaskManager.Task::(_decref) Task=`f41ad09c-4620-4f24-8aaa-e98c88eec421`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:30,702::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:30,703::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:30,714::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:31,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:31,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121163 s, 84.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:33,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:33,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128386 s, 79.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:04:33,912::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::DEBUG::2014-08-12 15:04:33,912::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:04:33,913::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:33,924::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000628294 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:04:33,925::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000628294 s, 3.3 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:04:33,925::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:04:33,925::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:04:33,925::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:04:33,926::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:04:33,926::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:04:33,926::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:04:33,926::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:04:33,927::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:04:33,927::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:34,248::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:04:34,249::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:04:34,249::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::INFO::2014-08-12 15:04:34,250::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::INFO::2014-08-12 15:04:34,250::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::INFO::2014-08-12 15:04:34,251::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:04:34,251::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:34,436::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:04:34,436::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:34,448::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564816 s, 7.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:04:34,451::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:34,452::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:04:34,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:34,452::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:34,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:34,452::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:34,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:34,452::__init__::225::IOProcess::(_processLogs) (14302) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:34,453::__init__::225::IOProcess::(_processLogs) (14302) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:34,453::__init__::225::IOProcess::(_processLogs) DEBUG|(14302) Building response >Thread-25::DEBUG::2014-08-12 15:04:34,453::__init__::225::IOProcess::(_processLogs) (14302) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:34,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:34,453::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:04:34,454::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:34,454::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:04:34,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:34,455::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:34,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:34,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:34,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:34,455::__init__::225::IOProcess::(_processLogs) (14303) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:34,455::__init__::225::IOProcess::(_processLogs) (14303) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:34,456::__init__::225::IOProcess::(_processLogs) (14303) Building response >Thread-25::DEBUG::2014-08-12 15:04:34,456::__init__::225::IOProcess::(_processLogs) (14303) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:34,456::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:34,456::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:04:34,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:04:34,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589012 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:35,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:35,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132523 s, 77.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:35,720::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:35,721::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:35,737::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:37,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:37,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130756 s, 78.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:38,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`f849db7f-810f-4335-907e-ebb60bc50df5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:38,390::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:04:38,390::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564816', 'lastCheck': '3.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589012', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:04:38,391::task::1191::Storage.TaskManager.Task::(prepare) Task=`f849db7f-810f-4335-907e-ebb60bc50df5`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564816', 'lastCheck': '3.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589012', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:04:38,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`f849db7f-810f-4335-907e-ebb60bc50df5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:38,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:38,391::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:38,391::task::993::Storage.TaskManager.Task::(_decref) Task=`f849db7f-810f-4335-907e-ebb60bc50df5`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:04:38,413::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:39,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:39,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119472 s, 85.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:39,782::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:04:39,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`6839ca4c-7a8a-42d9-914d-df5853252c3c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:39,783::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:04:39,811::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:39,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`6839ca4c-7a8a-42d9-914d-df5853252c3c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:39,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`6839ca4c-7a8a-42d9-914d-df5853252c3c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:39,811::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:39,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:39,812::task::993::Storage.TaskManager.Task::(_decref) Task=`6839ca4c-7a8a-42d9-914d-df5853252c3c`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:04:39,824::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:04:39,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`86847ce9-5651-461b-92ee-6e95093febfd`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:04:39,825::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:04:39,825::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`5fb7327f-7606-45f0-87b0-b912a0d76f9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:04:39,825::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:04:39,826::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:04:39,826::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`5fb7327f-7606-45f0-87b0-b912a0d76f9d`::Granted request >Thread-32::DEBUG::2014-08-12 15:04:39,826::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`86847ce9-5651-461b-92ee-6e95093febfd`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:04:39,826::task::993::Storage.TaskManager.Task::(_decref) Task=`86847ce9-5651-461b-92ee-6e95093febfd`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:04:39,839::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:39,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`86847ce9-5651-461b-92ee-6e95093febfd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:39,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`86847ce9-5651-461b-92ee-6e95093febfd`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:04:39,839::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:04:39,839::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:04:39,840::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:04:39,840::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:04:39,840::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:04:39,840::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:04:39,840::task::993::Storage.TaskManager.Task::(_decref) Task=`86847ce9-5651-461b-92ee-6e95093febfd`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:40,744::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:40,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:40,755::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:41,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:41,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121263 s, 84.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:43,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:43,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119487 s, 85.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:04:44,457::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:44,469::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701431 s, 5.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:04:44,477::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:44,477::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:04:44,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:44,478::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:44,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:44,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:44,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:44,479::__init__::225::IOProcess::(_processLogs) (14304) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:44,479::__init__::225::IOProcess::(_processLogs) (14304) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:44,479::__init__::225::IOProcess::(_processLogs) (14304) Building response >Thread-25::DEBUG::2014-08-12 15:04:44,479::__init__::225::IOProcess::(_processLogs) (14304) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:44,480::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:44,480::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:04:44,481::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:44,481::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:04:44,481::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:44,481::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:44,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:44,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:44,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:44,482::__init__::225::IOProcess::(_processLogs) (14305) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:44,482::__init__::225::IOProcess::(_processLogs) (14305) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:44,483::__init__::225::IOProcess::(_processLogs) (14305) Building response >Thread-25::DEBUG::2014-08-12 15:04:44,483::__init__::225::IOProcess::(_processLogs) (14305) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:44,483::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:44,483::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:04:44,897::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:04:44,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604787 s, 6.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:45,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:45,762::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:45,772::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:45,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:45,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352633 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:48,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:48,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120111 s, 85.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:49,857::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:04:49,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`3933e8a3-4c53-44c4-8f41-05a31da8a056`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:49,858::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:04:49,871::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:49,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`3933e8a3-4c53-44c4-8f41-05a31da8a056`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:49,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`3933e8a3-4c53-44c4-8f41-05a31da8a056`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:49,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:49,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:49,871::task::993::Storage.TaskManager.Task::(_decref) Task=`3933e8a3-4c53-44c4-8f41-05a31da8a056`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:04:49,884::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:04:49,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf68712b-d533-4a63-aa66-6997c5fe9a9a`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:04:49,884::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:04:49,885::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2ae5ac70-4420-44e6-bca1-30f5dfbb9c13`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:04:49,885::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:04:49,885::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:04:49,885::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2ae5ac70-4420-44e6-bca1-30f5dfbb9c13`::Granted request >Thread-32::DEBUG::2014-08-12 15:04:49,886::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cf68712b-d533-4a63-aa66-6997c5fe9a9a`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:04:49,886::task::993::Storage.TaskManager.Task::(_decref) Task=`cf68712b-d533-4a63-aa66-6997c5fe9a9a`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:04:49,918::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:49,919::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf68712b-d533-4a63-aa66-6997c5fe9a9a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:49,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf68712b-d533-4a63-aa66-6997c5fe9a9a`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:04:49,919::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:04:49,919::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:04:49,919::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:04:49,920::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:04:49,920::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:04:49,920::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:04:49,920::task::993::Storage.TaskManager.Task::(_decref) Task=`cf68712b-d533-4a63-aa66-6997c5fe9a9a`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:04:50,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:50,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123916 s, 82.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:50,779::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:50,780::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:50,784::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-44::DEBUG::2014-08-12 15:04:51,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`d63ac918-e344-48ba-a10e-e84c21c7d8ea`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:04:51,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:04:51,518::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:04:51,518::task::1191::Storage.TaskManager.Task::(prepare) Task=`d63ac918-e344-48ba-a10e-e84c21c7d8ea`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:04:51,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`d63ac918-e344-48ba-a10e-e84c21c7d8ea`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:04:51,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:04:51,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:04:51,519::task::993::Storage.TaskManager.Task::(_decref) Task=`d63ac918-e344-48ba-a10e-e84c21c7d8ea`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:04:51,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`6be30f25-8fd4-4d0a-812f-e69628ff3693`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:04:51,519::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:04:51,520::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:04:51,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`6be30f25-8fd4-4d0a-812f-e69628ff3693`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:04:51,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`6be30f25-8fd4-4d0a-812f-e69628ff3693`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:04:51,520::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:04:51,520::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:04:51,520::task::993::Storage.TaskManager.Task::(_decref) Task=`6be30f25-8fd4-4d0a-812f-e69628ff3693`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:04:51,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff7c5692-b026-41b3-ba27-a81d838c9f65`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:04:51,521::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:04:51,522::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:04:51,522::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff7c5692-b026-41b3-ba27-a81d838c9f65`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:04:51,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff7c5692-b026-41b3-ba27-a81d838c9f65`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:04:51,523::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:04:51,523::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:04:51,523::task::993::Storage.TaskManager.Task::(_decref) Task=`ff7c5692-b026-41b3-ba27-a81d838c9f65`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:04:51,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`60683aec-895e-4e4c-bf48-3ee38d537669`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:04:51,524::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:04:51,525::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:04:51,525::task::1191::Storage.TaskManager.Task::(prepare) Task=`60683aec-895e-4e4c-bf48-3ee38d537669`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:04:51,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`60683aec-895e-4e4c-bf48-3ee38d537669`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:04:51,525::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:04:51,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:04:51,526::task::993::Storage.TaskManager.Task::(_decref) Task=`60683aec-895e-4e4c-bf48-3ee38d537669`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:04:52,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:52,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121454 s, 84.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:04:53,456::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::DEBUG::2014-08-12 15:04:53,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`f562bb99-f988-4c90-9f9c-1d2ae74e6a47`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:53,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:04:53,512::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701431', 'lastCheck': '9.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604787', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:04:53,512::task::1191::Storage.TaskManager.Task::(prepare) Task=`f562bb99-f988-4c90-9f9c-1d2ae74e6a47`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701431', 'lastCheck': '9.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604787', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:04:53,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`f562bb99-f988-4c90-9f9c-1d2ae74e6a47`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:53,513::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:53,513::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:53,513::task::993::Storage.TaskManager.Task::(_decref) Task=`f562bb99-f988-4c90-9f9c-1d2ae74e6a47`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:04:53,538::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:54,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:54,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012014 s, 85.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:04:54,485::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:04:54,497::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756919 s, 5.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:04:54,500::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:54,500::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:04:54,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:54,500::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:54,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:54,501::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:54,501::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:54,501::__init__::225::IOProcess::(_processLogs) (14306) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:54,501::__init__::225::IOProcess::(_processLogs) (14306) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:54,501::__init__::225::IOProcess::(_processLogs) (14306) Building response >Thread-25::DEBUG::2014-08-12 15:04:54,501::__init__::225::IOProcess::(_processLogs) (14306) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:54,502::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:54,502::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:04:54,503::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:04:54,503::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:04:54,503::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:04:54,503::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:04:54,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:04:54,503::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:04:54,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:04:54,504::__init__::225::IOProcess::(_processLogs) (14307) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:04:54,504::__init__::225::IOProcess::(_processLogs) (14307) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:04:54,504::__init__::225::IOProcess::(_processLogs) (14307) Building response >Thread-25::DEBUG::2014-08-12 15:04:54,504::__init__::225::IOProcess::(_processLogs) (14307) Queuing response >Thread-25::DEBUG::2014-08-12 15:04:54,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:04:54,504::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:04:54,909::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:04:54,919::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636239 s, 6.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:55,790::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:55,791::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:04:55,807::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:04:56,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:56,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120351 s, 85.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:04:58,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:04:58,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121181 s, 84.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:04:59,936::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:04:59,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`404b1c55-7e53-4b26-9afc-16ae2dc3f475`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:04:59,937::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:04:59,950::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:59,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`404b1c55-7e53-4b26-9afc-16ae2dc3f475`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:04:59,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`404b1c55-7e53-4b26-9afc-16ae2dc3f475`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:04:59,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:04:59,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:04:59,951::task::993::Storage.TaskManager.Task::(_decref) Task=`404b1c55-7e53-4b26-9afc-16ae2dc3f475`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:04:59,970::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:04:59,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`0424fb1a-32e1-4def-97c0-7f0d4375dfad`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:04:59,970::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:04:59,971::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`484f1599-67bb-4c08-b17e-d5bdedd31e6e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:04:59,971::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:04:59,971::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:04:59,972::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`484f1599-67bb-4c08-b17e-d5bdedd31e6e`::Granted request >Thread-32::DEBUG::2014-08-12 15:04:59,972::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0424fb1a-32e1-4def-97c0-7f0d4375dfad`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:04:59,972::task::993::Storage.TaskManager.Task::(_decref) Task=`0424fb1a-32e1-4def-97c0-7f0d4375dfad`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:04:59,985::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:59,985::task::1191::Storage.TaskManager.Task::(prepare) Task=`0424fb1a-32e1-4def-97c0-7f0d4375dfad`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:04:59,985::task::595::Storage.TaskManager.Task::(_updateState) Task=`0424fb1a-32e1-4def-97c0-7f0d4375dfad`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:04:59,985::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:04:59,985::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:04:59,986::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:04:59,986::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:04:59,986::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:04:59,986::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:04:59,986::task::993::Storage.TaskManager.Task::(_decref) Task=`0424fb1a-32e1-4def-97c0-7f0d4375dfad`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:05:00,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:00,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121378 s, 84.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:00,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:00,813::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:00,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:02,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:02,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121188 s, 84.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:05:04,506::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:05:04,518::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721254 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:05:04,521::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:04,521::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:05:04,521::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:04,521::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:04,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:04,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:04,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:04,522::__init__::225::IOProcess::(_processLogs) (14308) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:04,522::__init__::225::IOProcess::(_processLogs) (14308) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:04,522::__init__::225::IOProcess::(_processLogs) (14308) Building response >Thread-25::DEBUG::2014-08-12 15:05:04,523::__init__::225::IOProcess::(_processLogs) (14308) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:04,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:04,523::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:05:04,524::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:04,524::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:05:04,524::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:04,524::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:04,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:04,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:04,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:04,525::__init__::225::IOProcess::(_processLogs) (14309) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:04,525::__init__::225::IOProcess::(_processLogs) (14309) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:04,525::__init__::225::IOProcess::(_processLogs) (14309) Building response >Thread-25::DEBUG::2014-08-12 15:05:04,525::__init__::225::IOProcess::(_processLogs) (14309) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:04,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:04,526::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:05:04,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:04,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128516 s, 79.7 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:05:04,921::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:04,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681503 s, 6.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:05,823::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:05,831::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:05,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:06,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:06,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135911 s, 75.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:05:08,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`0fc68c43-9a31-4e0c-b675-a168918a92fa`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:08,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:05:08,630::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721254', 'lastCheck': '4.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681503', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:05:08,630::task::1191::Storage.TaskManager.Task::(prepare) Task=`0fc68c43-9a31-4e0c-b675-a168918a92fa`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721254', 'lastCheck': '4.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681503', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:05:08,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`0fc68c43-9a31-4e0c-b675-a168918a92fa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:08,631::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:08,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:08,631::task::993::Storage.TaskManager.Task::(_decref) Task=`0fc68c43-9a31-4e0c-b675-a168918a92fa`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:05:08,653::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:08,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:08,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123365 s, 83.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:05:10,003::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:05:10,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`17da7cac-023d-4e74-ae6c-25356d7016b6`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:10,004::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:05:10,029::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:10,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`17da7cac-023d-4e74-ae6c-25356d7016b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:10,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`17da7cac-023d-4e74-ae6c-25356d7016b6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:10,030::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:10,030::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:10,030::task::993::Storage.TaskManager.Task::(_decref) Task=`17da7cac-023d-4e74-ae6c-25356d7016b6`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:05:10,041::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:05:10,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`fea19c0b-442b-41cc-a6a1-64b9c7e4f582`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:05:10,042::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:05:10,042::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`fabca2de-f1ef-4995-bd0b-ca99a1f30acc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:05:10,042::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:05:10,043::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:05:10,043::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`fabca2de-f1ef-4995-bd0b-ca99a1f30acc`::Granted request >Thread-32::DEBUG::2014-08-12 15:05:10,043::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fea19c0b-442b-41cc-a6a1-64b9c7e4f582`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:05:10,043::task::993::Storage.TaskManager.Task::(_decref) Task=`fea19c0b-442b-41cc-a6a1-64b9c7e4f582`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:05:10,056::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:10,056::task::1191::Storage.TaskManager.Task::(prepare) Task=`fea19c0b-442b-41cc-a6a1-64b9c7e4f582`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:10,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`fea19c0b-442b-41cc-a6a1-64b9c7e4f582`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:05:10,056::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:05:10,057::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:05:10,057::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:05:10,057::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:05:10,057::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:05:10,057::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:05:10,058::task::993::Storage.TaskManager.Task::(_decref) Task=`fea19c0b-442b-41cc-a6a1-64b9c7e4f582`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:10,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:10,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:10,848::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:10,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:11,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121755 s, 84.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:13,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:13,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120581 s, 84.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:05:14,527::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:05:14,539::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638732 s, 6.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:05:14,543::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:14,543::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:05:14,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:14,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:14,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:14,543::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:14,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:14,544::__init__::225::IOProcess::(_processLogs) (14310) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:14,544::__init__::225::IOProcess::(_processLogs) (14310) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:14,544::__init__::225::IOProcess::(_processLogs) (14310) Building response >Thread-25::DEBUG::2014-08-12 15:05:14,544::__init__::225::IOProcess::(_processLogs) (14310) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:14,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:14,544::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:05:14,545::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:14,545::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:05:14,546::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:14,546::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:14,546::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:14,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:14,546::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:14,546::__init__::225::IOProcess::(_processLogs) (14311) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:14,547::__init__::225::IOProcess::(_processLogs) (14311) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:14,547::__init__::225::IOProcess::(_processLogs) (14311) Building response >Thread-25::DEBUG::2014-08-12 15:05:14,547::__init__::225::IOProcess::(_processLogs) (14311) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:14,547::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:14,547::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:05:14,935::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:14,946::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650408 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:15,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:15,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121437 s, 84.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:15,856::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:15,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:15,867::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:17,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:17,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122691 s, 83.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:19,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:19,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122195 s, 83.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:05:20,073::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:05:20,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d85324a-857a-4f72-ad34-ee9106daf9b4`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:20,074::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:05:20,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:20,104::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d85324a-857a-4f72-ad34-ee9106daf9b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:20,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d85324a-857a-4f72-ad34-ee9106daf9b4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:20,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:20,105::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:20,105::task::993::Storage.TaskManager.Task::(_decref) Task=`1d85324a-857a-4f72-ad34-ee9106daf9b4`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:05:20,117::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:05:20,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ddb768f-24de-4b7e-9016-ce599d400705`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:05:20,118::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:05:20,118::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d3282b7a-2d25-4157-9305-c29ca9aa6c25`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:05:20,118::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:05:20,119::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:05:20,119::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d3282b7a-2d25-4157-9305-c29ca9aa6c25`::Granted request >Thread-32::DEBUG::2014-08-12 15:05:20,119::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2ddb768f-24de-4b7e-9016-ce599d400705`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:05:20,119::task::993::Storage.TaskManager.Task::(_decref) Task=`2ddb768f-24de-4b7e-9016-ce599d400705`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:05:20,132::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:20,132::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ddb768f-24de-4b7e-9016-ce599d400705`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:20,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ddb768f-24de-4b7e-9016-ce599d400705`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:05:20,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:05:20,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:05:20,133::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:05:20,133::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:05:20,133::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:05:20,134::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:05:20,134::task::993::Storage.TaskManager.Task::(_decref) Task=`2ddb768f-24de-4b7e-9016-ce599d400705`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:20,874::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:20,875::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:20,883::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:21,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:21,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120447 s, 85.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:23,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:23,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124235 s, 82.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:05:23,492::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::DEBUG::2014-08-12 15:05:23,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`a30a2c6e-f7b5-4345-b760-0dda43e27461`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:23,747::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:05:23,747::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638732', 'lastCheck': '9.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650408', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:05:23,748::task::1191::Storage.TaskManager.Task::(prepare) Task=`a30a2c6e-f7b5-4345-b760-0dda43e27461`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638732', 'lastCheck': '9.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650408', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:05:23,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`a30a2c6e-f7b5-4345-b760-0dda43e27461`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:23,748::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:23,748::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:23,748::task::993::Storage.TaskManager.Task::(_decref) Task=`a30a2c6e-f7b5-4345-b760-0dda43e27461`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:05:23,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-16::DEBUG::2014-08-12 15:05:24,549::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:05:24,561::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000577315 s, 7.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:05:24,565::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:24,565::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:05:24,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:24,565::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:24,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:24,565::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:24,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:24,566::__init__::225::IOProcess::(_processLogs) (14312) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:24,566::__init__::225::IOProcess::(_processLogs) (14312) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:24,566::__init__::225::IOProcess::(_processLogs) (14312) Building response >Thread-25::DEBUG::2014-08-12 15:05:24,566::__init__::225::IOProcess::(_processLogs) (14312) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:24,566::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:24,567::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:05:24,567::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:24,568::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:05:24,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:24,568::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:24,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:24,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:24,568::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:24,569::__init__::225::IOProcess::(_processLogs) (14313) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:24,569::__init__::225::IOProcess::(_processLogs) (14313) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:24,569::__init__::225::IOProcess::(_processLogs) (14313) Building response >Thread-25::DEBUG::2014-08-12 15:05:24,569::__init__::225::IOProcess::(_processLogs) (14313) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:24,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:24,569::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:05:24,948::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-33::DEBUG::2014-08-12 15:05:24,948::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:05:24,949::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:24,959::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000553927 s, 3.7 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:05:24,959::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000553927 s, 3.7 MB/s'], size: 2048 >Thread-33::DEBUG::2014-08-12 15:05:24,960::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-33::DEBUG::2014-08-12 15:05:24,960::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-33::DEBUG::2014-08-12 15:05:24,960::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:05:24,960::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:05:24,961::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:05:24,961::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:05:24,961::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:05:24,961::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:05:24,962::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:25,208::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:05:25,209::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:05:25,209::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-33::INFO::2014-08-12 15:05:25,210::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-33::INFO::2014-08-12 15:05:25,210::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-33::INFO::2014-08-12 15:05:25,210::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-33::DEBUG::2014-08-12 15:05:25,211::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:25,384::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:05:25,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:25,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000570581 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:25,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:25,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139221 s, 73.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:25,890::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:25,890::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:25,907::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:27,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:27,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122055 s, 83.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:29,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:29,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120858 s, 84.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:05:30,149::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:05:30,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`f48c4def-6e96-4b35-9bab-7e03e89d3591`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:30,150::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:05:30,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:30,163::task::1191::Storage.TaskManager.Task::(prepare) Task=`f48c4def-6e96-4b35-9bab-7e03e89d3591`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:30,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`f48c4def-6e96-4b35-9bab-7e03e89d3591`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:30,163::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:30,163::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:30,164::task::993::Storage.TaskManager.Task::(_decref) Task=`f48c4def-6e96-4b35-9bab-7e03e89d3591`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:05:30,174::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:05:30,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3aa1e90-189c-421d-8d07-0c2a47bb57ff`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:05:30,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:05:30,176::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`e5c82255-f3d3-4ad1-a8f4-4e4218f49e54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:05:30,176::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:05:30,177::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:05:30,177::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`e5c82255-f3d3-4ad1-a8f4-4e4218f49e54`::Granted request >Thread-32::DEBUG::2014-08-12 15:05:30,177::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a3aa1e90-189c-421d-8d07-0c2a47bb57ff`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:05:30,177::task::993::Storage.TaskManager.Task::(_decref) Task=`a3aa1e90-189c-421d-8d07-0c2a47bb57ff`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:05:30,190::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:30,190::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3aa1e90-189c-421d-8d07-0c2a47bb57ff`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:30,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3aa1e90-189c-421d-8d07-0c2a47bb57ff`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:05:30,190::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:05:30,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:05:30,191::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:05:30,191::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:05:30,191::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:05:30,191::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:05:30,191::task::993::Storage.TaskManager.Task::(_decref) Task=`a3aa1e90-189c-421d-8d07-0c2a47bb57ff`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:30,913::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:30,914::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:30,924::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:31,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:31,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122376 s, 83.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:33,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:33,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121293 s, 84.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:05:34,571::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:05:34,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000794423 s, 5.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:05:34,586::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:34,586::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:05:34,586::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:34,586::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:34,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:34,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:34,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:34,587::__init__::225::IOProcess::(_processLogs) (14314) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:34,587::__init__::225::IOProcess::(_processLogs) (14314) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:34,587::__init__::225::IOProcess::(_processLogs) (14314) Building response >Thread-25::DEBUG::2014-08-12 15:05:34,587::__init__::225::IOProcess::(_processLogs) (14314) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:34,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:34,588::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:05:34,589::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:34,589::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:05:34,589::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:34,589::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:34,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:34,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:34,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:34,590::__init__::225::IOProcess::(_processLogs) (14315) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:34,590::__init__::225::IOProcess::(_processLogs) (14315) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:34,590::__init__::225::IOProcess::(_processLogs) (14315) Building response >Thread-25::DEBUG::2014-08-12 15:05:34,590::__init__::225::IOProcess::(_processLogs) (14315) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:34,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:34,590::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:05:35,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:35,408::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631807 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:35,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:35,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252888 s, 40.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:35,931::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:35,931::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:35,948::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:37,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:37,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121983 s, 83.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:05:38,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa65b679-0c8e-4cf5-a243-cbcfba8aa0b5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:38,865::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:05:38,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000794423', 'lastCheck': '4.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631807', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:05:38,866::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa65b679-0c8e-4cf5-a243-cbcfba8aa0b5`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000794423', 'lastCheck': '4.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631807', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:05:38,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa65b679-0c8e-4cf5-a243-cbcfba8aa0b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:38,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:38,866::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:38,866::task::993::Storage.TaskManager.Task::(_decref) Task=`aa65b679-0c8e-4cf5-a243-cbcfba8aa0b5`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:05:38,892::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:39,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:40,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119645 s, 85.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:05:40,217::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:05:40,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd64d0a2-f5f1-4979-af68-d811e7d2bfd7`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:40,218::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:05:40,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:40,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd64d0a2-f5f1-4979-af68-d811e7d2bfd7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:40,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd64d0a2-f5f1-4979-af68-d811e7d2bfd7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:40,255::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:40,256::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:40,256::task::993::Storage.TaskManager.Task::(_decref) Task=`fd64d0a2-f5f1-4979-af68-d811e7d2bfd7`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:05:40,268::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:05:40,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b8a7f26-950e-4fad-b791-1c33f89e7c4b`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:05:40,268::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:05:40,269::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c8222abe-8d89-4190-bb66-60bc1e379c1d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:05:40,269::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:05:40,269::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:05:40,270::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c8222abe-8d89-4190-bb66-60bc1e379c1d`::Granted request >Thread-32::DEBUG::2014-08-12 15:05:40,270::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b8a7f26-950e-4fad-b791-1c33f89e7c4b`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:05:40,270::task::993::Storage.TaskManager.Task::(_decref) Task=`4b8a7f26-950e-4fad-b791-1c33f89e7c4b`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:05:40,283::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:40,283::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b8a7f26-950e-4fad-b791-1c33f89e7c4b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:40,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b8a7f26-950e-4fad-b791-1c33f89e7c4b`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:05:40,283::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:05:40,283::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:05:40,284::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:05:40,284::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:05:40,284::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:05:40,284::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:05:40,284::task::993::Storage.TaskManager.Task::(_decref) Task=`4b8a7f26-950e-4fad-b791-1c33f89e7c4b`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:40,954::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:40,955::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:40,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:42,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:42,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168565 s, 60.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:44,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:44,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121182 s, 84.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:05:44,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:05:44,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696451 s, 5.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:05:44,607::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:44,608::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:05:44,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:44,608::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:44,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:44,608::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:44,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:44,609::__init__::225::IOProcess::(_processLogs) (14316) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:44,609::__init__::225::IOProcess::(_processLogs) (14316) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:44,609::__init__::225::IOProcess::(_processLogs) (14316) Building response >Thread-25::DEBUG::2014-08-12 15:05:44,609::__init__::225::IOProcess::(_processLogs) (14316) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:44,609::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:44,609::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:05:44,610::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:44,610::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:05:44,611::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:44,611::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:44,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:44,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:44,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:44,611::__init__::225::IOProcess::(_processLogs) (14317) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:44,612::__init__::225::IOProcess::(_processLogs) (14317) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:44,612::__init__::225::IOProcess::(_processLogs) (14317) Building response >Thread-25::DEBUG::2014-08-12 15:05:44,612::__init__::225::IOProcess::(_processLogs) (14317) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:44,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:44,612::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:05:45,410::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:45,428::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00815325 s, 502 kB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:45,973::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:45,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:45,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:46,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:46,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0197934 s, 51.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:48,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:48,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121363 s, 84.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:05:50,299::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [78ec6cc5] >Thread-14::DEBUG::2014-08-12 15:05:50,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`49f92ad8-a98b-43b0-994f-5f8bbddaaeef`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:50,300::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:05:50,314::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:50,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`49f92ad8-a98b-43b0-994f-5f8bbddaaeef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:05:50,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`49f92ad8-a98b-43b0-994f-5f8bbddaaeef`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:50,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:50,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:50,314::task::993::Storage.TaskManager.Task::(_decref) Task=`49f92ad8-a98b-43b0-994f-5f8bbddaaeef`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:05:50,325::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [78ec6cc5] >Thread-32::DEBUG::2014-08-12 15:05:50,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`9171f886-dd91-468c-b142-8c6eb01ba832`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:05:50,326::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:05:50,327::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`256c9d21-e6ea-4708-bd2e-56d28c8e43da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:05:50,327::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:05:50,327::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:05:50,327::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`256c9d21-e6ea-4708-bd2e-56d28c8e43da`::Granted request >Thread-32::DEBUG::2014-08-12 15:05:50,328::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9171f886-dd91-468c-b142-8c6eb01ba832`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:05:50,328::task::993::Storage.TaskManager.Task::(_decref) Task=`9171f886-dd91-468c-b142-8c6eb01ba832`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:05:50,340::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:50,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`9171f886-dd91-468c-b142-8c6eb01ba832`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:05:50,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`9171f886-dd91-468c-b142-8c6eb01ba832`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:05:50,341::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:05:50,341::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:05:50,341::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:05:50,342::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:05:50,342::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:05:50,342::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:05:50,342::task::993::Storage.TaskManager.Task::(_decref) Task=`9171f886-dd91-468c-b142-8c6eb01ba832`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:05:50,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:50,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131835 s, 77.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:50,987::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:50,995::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:50,995::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:52,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-44::DEBUG::2014-08-12 15:05:52,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1f423b7-2690-406e-ba82-5c05c5d045e2`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:05:52,544::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:05:52,544::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:05:52,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1f423b7-2690-406e-ba82-5c05c5d045e2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:05:52,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1f423b7-2690-406e-ba82-5c05c5d045e2`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:05:52,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:05:52,545::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:05:52,545::task::993::Storage.TaskManager.Task::(_decref) Task=`c1f423b7-2690-406e-ba82-5c05c5d045e2`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:05:52,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b3b53ec-cc60-45ed-979a-108cbb37a703`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:05:52,545::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:05:52,546::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:05:52,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b3b53ec-cc60-45ed-979a-108cbb37a703`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:05:52,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b3b53ec-cc60-45ed-979a-108cbb37a703`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:05:52,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:05:52,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:05:52,547::task::993::Storage.TaskManager.Task::(_decref) Task=`2b3b53ec-cc60-45ed-979a-108cbb37a703`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:05:52,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`107c7cee-8348-47e2-afc1-bd3b93522ecd`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:05:52,550::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:05:52,551::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:05:52,552::task::1191::Storage.TaskManager.Task::(prepare) Task=`107c7cee-8348-47e2-afc1-bd3b93522ecd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:05:52,552::task::595::Storage.TaskManager.Task::(_updateState) Task=`107c7cee-8348-47e2-afc1-bd3b93522ecd`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:05:52,553::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:05:52,554::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:05:52,555::task::993::Storage.TaskManager.Task::(_decref) Task=`107c7cee-8348-47e2-afc1-bd3b93522ecd`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:05:52,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`d90b98f8-e983-41e4-bbef-237ebada7593`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:05:52,557::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:05:52,559::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:05:52,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`d90b98f8-e983-41e4-bbef-237ebada7593`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:05:52,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`d90b98f8-e983-41e4-bbef-237ebada7593`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:05:52,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:05:52,562::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:05:52,562::task::993::Storage.TaskManager.Task::(_decref) Task=`d90b98f8-e983-41e4-bbef-237ebada7593`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:05:52,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279916 s, 36.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:05:53,556::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::DEBUG::2014-08-12 15:05:54,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`e64bf39b-653c-4130-b259-ee229a881bf4`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:05:54,000::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:05:54,000::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696451', 'lastCheck': '9.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00815325', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:05:54,000::task::1191::Storage.TaskManager.Task::(prepare) Task=`e64bf39b-653c-4130-b259-ee229a881bf4`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696451', 'lastCheck': '9.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00815325', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:05:54,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`e64bf39b-653c-4130-b259-ee229a881bf4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:05:54,001::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:05:54,001::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:05:54,001::task::993::Storage.TaskManager.Task::(_decref) Task=`e64bf39b-653c-4130-b259-ee229a881bf4`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:05:54,025::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-16::DEBUG::2014-08-12 15:05:54,614::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:54,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-16::DEBUG::2014-08-12 15:05:54,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635818 s, 6.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:05:54,641::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:54,641::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:05:54,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:54,642::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:54,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:54,642::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:54,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:54,642::__init__::225::IOProcess::(_processLogs) (14318) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:54,642::__init__::225::IOProcess::(_processLogs) (14318) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:54,643::__init__::225::IOProcess::(_processLogs) (14318) Building response >Thread-25::DEBUG::2014-08-12 15:05:54,643::__init__::225::IOProcess::(_processLogs) (14318) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:54,643::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:54,643::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:05:54,644::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:05:54,644::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:05:54,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:05:54,644::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:05:54,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:05:54,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:05:54,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:05:54,645::__init__::225::IOProcess::(_processLogs) (14319) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:05:54,645::__init__::225::IOProcess::(_processLogs) (14319) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:05:54,645::__init__::225::IOProcess::(_processLogs) (14319) Building response >Thread-25::DEBUG::2014-08-12 15:05:54,646::__init__::225::IOProcess::(_processLogs) (14319) Queuing response >Thread-25::DEBUG::2014-08-12 15:05:54,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:05:54,646::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:05:54,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128055 s, 80.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:05:55,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:05:55,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640946 s, 6.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:56,002::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:56,019::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:05:56,020::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:05:56,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:56,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269019 s, 38.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:05:58,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:05:58,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120314 s, 85.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:00,358::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [66f05af2] >Thread-14::DEBUG::2014-08-12 15:06:00,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`49fd8880-effa-498f-b107-20e2e9b03e3f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:00,359::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:06:00,371::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:00,372::task::1191::Storage.TaskManager.Task::(prepare) Task=`49fd8880-effa-498f-b107-20e2e9b03e3f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:00,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`49fd8880-effa-498f-b107-20e2e9b03e3f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:00,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:00,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:00,372::task::993::Storage.TaskManager.Task::(_decref) Task=`49fd8880-effa-498f-b107-20e2e9b03e3f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:06:00,384::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [66f05af2] >Thread-32::DEBUG::2014-08-12 15:06:00,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`706caeb9-7ecb-4e2b-9ecd-0d4e3d6e3ef4`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:06:00,384::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:06:00,387::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9ce1166e-e8b9-4495-899d-3a4aecb23b6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:06:00,387::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:06:00,387::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:06:00,387::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9ce1166e-e8b9-4495-899d-3a4aecb23b6f`::Granted request >Thread-32::DEBUG::2014-08-12 15:06:00,388::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`706caeb9-7ecb-4e2b-9ecd-0d4e3d6e3ef4`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:06:00,388::task::993::Storage.TaskManager.Task::(_decref) Task=`706caeb9-7ecb-4e2b-9ecd-0d4e3d6e3ef4`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:06:00,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:00,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`706caeb9-7ecb-4e2b-9ecd-0d4e3d6e3ef4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:00,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`706caeb9-7ecb-4e2b-9ecd-0d4e3d6e3ef4`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:06:00,401::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:06:00,401::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:06:00,401::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:06:00,401::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:06:00,401::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:06:00,402::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:06:00,402::task::993::Storage.TaskManager.Task::(_decref) Task=`706caeb9-7ecb-4e2b-9ecd-0d4e3d6e3ef4`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:06:00,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:00,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123138 s, 83.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:01,027::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:01,028::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:01,036::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:02,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:03,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122413 s, 83.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:06:04,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:06:04,661::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000773634 s, 5.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:06:04,664::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:04,664::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:06:04,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:04,664::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:04,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:04,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:04,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:04,665::__init__::225::IOProcess::(_processLogs) (14320) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:04,665::__init__::225::IOProcess::(_processLogs) (14320) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:04,665::__init__::225::IOProcess::(_processLogs) (14320) Building response >Thread-25::DEBUG::2014-08-12 15:06:04,665::__init__::225::IOProcess::(_processLogs) (14320) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:04,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:04,666::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:06:04,666::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:04,667::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:06:04,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:04,667::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:04,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:04,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:04,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:04,668::__init__::225::IOProcess::(_processLogs) (14321) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:04,668::__init__::225::IOProcess::(_processLogs) (14321) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:04,668::__init__::225::IOProcess::(_processLogs) (14321) Building response >Thread-25::DEBUG::2014-08-12 15:06:04,668::__init__::225::IOProcess::(_processLogs) (14321) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:04,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:04,668::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:06:05,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:05,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121374 s, 84.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:06:05,442::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:06:05,454::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000867904 s, 4.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:06,042::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:06,043::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:06,065::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:07,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:07,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011964 s, 85.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:09,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`31950535-1b6b-46c0-b40c-041d289f2160`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:09,124::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:06:09,124::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773634', 'lastCheck': '4.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867904', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:06:09,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`31950535-1b6b-46c0-b40c-041d289f2160`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773634', 'lastCheck': '4.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867904', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:06:09,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`31950535-1b6b-46c0-b40c-041d289f2160`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:09,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:09,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:09,125::task::993::Storage.TaskManager.Task::(_decref) Task=`31950535-1b6b-46c0-b40c-041d289f2160`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:06:09,148::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:09,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:09,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130552 s, 78.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:10,417::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:06:10,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`638d0c1a-89f5-4435-8b6c-a0b2b921a8bb`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:10,418::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:06:10,431::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:10,431::task::1191::Storage.TaskManager.Task::(prepare) Task=`638d0c1a-89f5-4435-8b6c-a0b2b921a8bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:10,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`638d0c1a-89f5-4435-8b6c-a0b2b921a8bb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:10,431::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:10,432::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:10,432::task::993::Storage.TaskManager.Task::(_decref) Task=`638d0c1a-89f5-4435-8b6c-a0b2b921a8bb`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:06:10,443::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:06:10,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`388decb6-d83d-4ee8-97d7-cce5b7277880`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:06:10,443::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:06:10,444::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c19bb4ac-570c-4096-9a6c-9962dc7ea623`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:06:10,444::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:06:10,445::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:06:10,445::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c19bb4ac-570c-4096-9a6c-9962dc7ea623`::Granted request >Thread-32::DEBUG::2014-08-12 15:06:10,445::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`388decb6-d83d-4ee8-97d7-cce5b7277880`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:06:10,445::task::993::Storage.TaskManager.Task::(_decref) Task=`388decb6-d83d-4ee8-97d7-cce5b7277880`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:06:10,458::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:10,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`388decb6-d83d-4ee8-97d7-cce5b7277880`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:10,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`388decb6-d83d-4ee8-97d7-cce5b7277880`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:06:10,458::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:06:10,458::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:06:10,459::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:06:10,459::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:06:10,459::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:06:10,459::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:06:10,459::task::993::Storage.TaskManager.Task::(_decref) Task=`388decb6-d83d-4ee8-97d7-cce5b7277880`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:11,074::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:11,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:11,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:11,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:11,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011943 s, 85.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:13,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:13,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120137 s, 85.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:06:14,670::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:06:14,682::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700247 s, 5.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:06:14,685::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:14,685::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:06:14,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:14,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:14,686::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:14,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:14,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:14,686::__init__::225::IOProcess::(_processLogs) (14322) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:14,686::__init__::225::IOProcess::(_processLogs) (14322) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:14,687::__init__::225::IOProcess::(_processLogs) (14322) Building response >Thread-25::DEBUG::2014-08-12 15:06:14,687::__init__::225::IOProcess::(_processLogs) (14322) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:14,687::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:14,687::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:06:14,688::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:14,688::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:06:14,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:14,688::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:14,689::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:14,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:14,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:14,689::__init__::225::IOProcess::(_processLogs) (14323) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:14,689::__init__::225::IOProcess::(_processLogs) (14323) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:14,689::__init__::225::IOProcess::(_processLogs) (14323) Building response >Thread-25::DEBUG::2014-08-12 15:06:14,690::__init__::225::IOProcess::(_processLogs) (14323) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:14,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:14,690::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:06:15,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:15,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122001 s, 83.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:06:15,472::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:06:15,486::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061588 s, 6.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:16,083::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:16,086::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:16,090::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:17,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:17,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120285 s, 85.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:19,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:19,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121419 s, 84.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:20,474::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:06:20,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`016d5f50-292e-4ece-ae1c-667a22002ed6`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:20,475::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:06:20,504::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:20,504::task::1191::Storage.TaskManager.Task::(prepare) Task=`016d5f50-292e-4ece-ae1c-667a22002ed6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:20,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`016d5f50-292e-4ece-ae1c-667a22002ed6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:20,504::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:20,505::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:20,505::task::993::Storage.TaskManager.Task::(_decref) Task=`016d5f50-292e-4ece-ae1c-667a22002ed6`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:06:20,517::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:06:20,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`a560c5d6-d0f6-43fd-966f-9da5af1932de`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:06:20,518::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:06:20,518::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`61db9c15-d2a7-4372-832c-f4120dba805c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:06:20,518::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:06:20,519::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:06:20,519::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`61db9c15-d2a7-4372-832c-f4120dba805c`::Granted request >Thread-32::DEBUG::2014-08-12 15:06:20,519::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a560c5d6-d0f6-43fd-966f-9da5af1932de`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:06:20,519::task::993::Storage.TaskManager.Task::(_decref) Task=`a560c5d6-d0f6-43fd-966f-9da5af1932de`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:06:20,532::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:20,532::task::1191::Storage.TaskManager.Task::(prepare) Task=`a560c5d6-d0f6-43fd-966f-9da5af1932de`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:20,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`a560c5d6-d0f6-43fd-966f-9da5af1932de`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:06:20,532::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:06:20,532::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:06:20,533::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:06:20,533::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:06:20,533::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:06:20,533::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:06:20,533::task::993::Storage.TaskManager.Task::(_decref) Task=`a560c5d6-d0f6-43fd-966f-9da5af1932de`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:21,096::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:21,097::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:21,098::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:21,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:21,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121408 s, 84.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:06:23,593::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:06:23,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:23,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120032 s, 85.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:24,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc54e965-c4e5-4296-9260-15cc0a65fed9`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:24,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:06:24,252::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700247', 'lastCheck': '9.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061588', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:06:24,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc54e965-c4e5-4296-9260-15cc0a65fed9`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700247', 'lastCheck': '9.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061588', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:06:24,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc54e965-c4e5-4296-9260-15cc0a65fed9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:24,253::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:24,253::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:24,253::task::993::Storage.TaskManager.Task::(_decref) Task=`dc54e965-c4e5-4296-9260-15cc0a65fed9`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:06:24,274::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-16::DEBUG::2014-08-12 15:06:24,692::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:06:24,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069168 s, 5.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:06:24,706::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:24,707::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:06:24,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:24,707::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:24,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:24,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:24,707::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:24,708::__init__::225::IOProcess::(_processLogs) (14324) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:24,708::__init__::225::IOProcess::(_processLogs) (14324) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:24,708::__init__::225::IOProcess::(_processLogs) (14324) Building response >Thread-25::DEBUG::2014-08-12 15:06:24,708::__init__::225::IOProcess::(_processLogs) (14324) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:24,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:24,709::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:06:24,710::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:24,710::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:06:24,710::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:24,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:24,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:24,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:24,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:24,711::__init__::225::IOProcess::(_processLogs) (14325) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:24,711::__init__::225::IOProcess::(_processLogs) (14325) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:24,711::__init__::225::IOProcess::(_processLogs) (14325) Building response >Thread-25::DEBUG::2014-08-12 15:06:24,711::__init__::225::IOProcess::(_processLogs) (14325) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:24,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:24,711::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:06:25,489::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:06:25,500::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667342 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:25,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:25,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01217 s, 84.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:26,104::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:26,105::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:26,123::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:27,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:27,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120083 s, 85.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:29,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:29,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120038 s, 85.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:30,563::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:06:30,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d3818b0-2b1f-4bda-ab57-85fe147a87cf`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:30,564::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:06:30,577::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:30,577::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d3818b0-2b1f-4bda-ab57-85fe147a87cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:30,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d3818b0-2b1f-4bda-ab57-85fe147a87cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:30,577::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:30,577::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:30,577::task::993::Storage.TaskManager.Task::(_decref) Task=`7d3818b0-2b1f-4bda-ab57-85fe147a87cf`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:06:30,589::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:06:30,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7fbaa11-8368-4ec8-a987-f09c0eb623a7`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:06:30,589::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:06:30,590::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`03fc39ec-93a6-492b-b0d7-464fdf9117ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:06:30,590::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:06:30,590::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:06:30,591::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`03fc39ec-93a6-492b-b0d7-464fdf9117ae`::Granted request >Thread-32::DEBUG::2014-08-12 15:06:30,591::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f7fbaa11-8368-4ec8-a987-f09c0eb623a7`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:06:30,591::task::993::Storage.TaskManager.Task::(_decref) Task=`f7fbaa11-8368-4ec8-a987-f09c0eb623a7`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:06:30,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:30,604::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7fbaa11-8368-4ec8-a987-f09c0eb623a7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:30,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7fbaa11-8368-4ec8-a987-f09c0eb623a7`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:06:30,604::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:06:30,604::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:06:30,605::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:06:30,605::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:06:30,605::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:06:30,605::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:06:30,606::task::993::Storage.TaskManager.Task::(_decref) Task=`f7fbaa11-8368-4ec8-a987-f09c0eb623a7`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:31,130::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:31,131::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:31,141::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:32,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:32,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120278 s, 85.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:34,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:34,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119455 s, 85.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:06:34,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:06:34,724::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722763 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:06:34,728::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:34,728::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:06:34,728::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:34,728::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:34,728::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:34,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:34,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:34,729::__init__::225::IOProcess::(_processLogs) (14326) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:34,729::__init__::225::IOProcess::(_processLogs) (14326) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:34,729::__init__::225::IOProcess::(_processLogs) (14326) Building response >Thread-25::DEBUG::2014-08-12 15:06:34,729::__init__::225::IOProcess::(_processLogs) (14326) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:34,729::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:34,730::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:06:34,730::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:34,731::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:06:34,731::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:34,731::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:34,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:34,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:34,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:34,732::__init__::225::IOProcess::(_processLogs) (14327) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:34,732::__init__::225::IOProcess::(_processLogs) (14327) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:34,732::__init__::225::IOProcess::(_processLogs) (14327) Building response >Thread-25::DEBUG::2014-08-12 15:06:34,732::__init__::225::IOProcess::(_processLogs) (14327) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:34,732::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:34,732::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:06:35,502::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:06:35,513::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635846 s, 6.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:36,148::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:36,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:36,151::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:36,176::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:36,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119813 s, 85.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:38,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:38,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120962 s, 84.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:39,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`68685aa9-7b5d-4917-99e6-3507ef223528`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:39,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:06:39,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722763', 'lastCheck': '4.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635846', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:06:39,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`68685aa9-7b5d-4917-99e6-3507ef223528`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722763', 'lastCheck': '4.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635846', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:06:39,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`68685aa9-7b5d-4917-99e6-3507ef223528`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:39,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:39,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:39,370::task::993::Storage.TaskManager.Task::(_decref) Task=`68685aa9-7b5d-4917-99e6-3507ef223528`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:06:39,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:40,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:40,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119838 s, 85.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:40,626::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:06:40,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`a68c0d78-a447-4b00-850d-bd6de32f548b`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:40,627::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:06:40,642::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:40,643::task::1191::Storage.TaskManager.Task::(prepare) Task=`a68c0d78-a447-4b00-850d-bd6de32f548b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:40,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`a68c0d78-a447-4b00-850d-bd6de32f548b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:40,644::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:40,644::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:40,644::task::993::Storage.TaskManager.Task::(_decref) Task=`a68c0d78-a447-4b00-850d-bd6de32f548b`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:06:40,656::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:06:40,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`b372d7c2-9426-4055-afb4-e082f4bb6a7f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:06:40,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:06:40,658::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`46494eaf-beb8-47a1-ac6d-50fc3e4908c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:06:40,658::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:06:40,659::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:06:40,659::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`46494eaf-beb8-47a1-ac6d-50fc3e4908c1`::Granted request >Thread-32::DEBUG::2014-08-12 15:06:40,660::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b372d7c2-9426-4055-afb4-e082f4bb6a7f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:06:40,660::task::993::Storage.TaskManager.Task::(_decref) Task=`b372d7c2-9426-4055-afb4-e082f4bb6a7f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:06:40,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:40,680::task::1191::Storage.TaskManager.Task::(prepare) Task=`b372d7c2-9426-4055-afb4-e082f4bb6a7f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:40,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`b372d7c2-9426-4055-afb4-e082f4bb6a7f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:06:40,681::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:06:40,681::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:06:40,682::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:06:40,682::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:06:40,682::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:06:40,682::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:06:40,683::task::993::Storage.TaskManager.Task::(_decref) Task=`b372d7c2-9426-4055-afb4-e082f4bb6a7f`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:41,179::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:41,180::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:41,188::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:42,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:42,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121435 s, 84.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:44,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:44,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121331 s, 84.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:06:44,734::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:06:44,746::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681229 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:06:44,750::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:44,750::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:06:44,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:44,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:44,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:44,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:44,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:44,751::__init__::225::IOProcess::(_processLogs) (14328) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:44,751::__init__::225::IOProcess::(_processLogs) (14328) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:44,751::__init__::225::IOProcess::(_processLogs) (14328) Building response >Thread-25::DEBUG::2014-08-12 15:06:44,751::__init__::225::IOProcess::(_processLogs) (14328) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:44,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:44,752::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:06:44,752::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:44,753::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:06:44,753::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:44,753::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:44,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:44,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:44,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:44,754::__init__::225::IOProcess::(_processLogs) (14329) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:44,754::__init__::225::IOProcess::(_processLogs) (14329) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:44,754::__init__::225::IOProcess::(_processLogs) (14329) Building response >Thread-25::DEBUG::2014-08-12 15:06:44,754::__init__::225::IOProcess::(_processLogs) (14329) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:44,754::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:44,754::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:06:45,515::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:06:45,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759547 s, 5.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:46,196::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:46,199::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:46,207::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:46,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:46,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185963 s, 55.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:48,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:48,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120539 s, 85.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:06:50,698::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:06:50,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`06afbdc4-380a-44bb-a1b0-75acdbb51548`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:50,699::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:06:50,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:50,711::task::1191::Storage.TaskManager.Task::(prepare) Task=`06afbdc4-380a-44bb-a1b0-75acdbb51548`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:06:50,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`06afbdc4-380a-44bb-a1b0-75acdbb51548`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:50,711::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:50,712::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:50,712::task::993::Storage.TaskManager.Task::(_decref) Task=`06afbdc4-380a-44bb-a1b0-75acdbb51548`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:06:50,723::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:06:50,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae9aa602-1b54-4301-bfee-7ad231b3c37c`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:06:50,724::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:06:50,724::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ff6cebf9-1638-4451-8bbf-5e976a0b1727`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:06:50,724::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:06:50,725::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:06:50,725::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ff6cebf9-1638-4451-8bbf-5e976a0b1727`::Granted request >Thread-32::DEBUG::2014-08-12 15:06:50,725::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ae9aa602-1b54-4301-bfee-7ad231b3c37c`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:06:50,725::task::993::Storage.TaskManager.Task::(_decref) Task=`ae9aa602-1b54-4301-bfee-7ad231b3c37c`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:06:50,738::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:50,738::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae9aa602-1b54-4301-bfee-7ad231b3c37c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:06:50,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae9aa602-1b54-4301-bfee-7ad231b3c37c`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:06:50,738::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:06:50,738::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:06:50,739::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:06:50,739::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:06:50,739::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:06:50,739::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:06:50,739::task::993::Storage.TaskManager.Task::(_decref) Task=`ae9aa602-1b54-4301-bfee-7ad231b3c37c`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:06:50,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:50,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254565 s, 40.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:51,215::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:51,215::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:51,223::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:52,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:52,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121606 s, 84.2 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:06:53,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bdbc5d6-b75e-4859-af04-45d37f0456d8`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:06:53,515::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:06:53,516::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:06:53,516::task::1191::Storage.TaskManager.Task::(prepare) Task=`0bdbc5d6-b75e-4859-af04-45d37f0456d8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:06:53,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bdbc5d6-b75e-4859-af04-45d37f0456d8`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:06:53,516::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:06:53,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:06:53,516::task::993::Storage.TaskManager.Task::(_decref) Task=`0bdbc5d6-b75e-4859-af04-45d37f0456d8`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:06:53,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`e81d0c96-995d-43cd-b021-9f8c098f7cd9`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:06:53,517::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:06:53,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:06:53,517::task::1191::Storage.TaskManager.Task::(prepare) Task=`e81d0c96-995d-43cd-b021-9f8c098f7cd9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:06:53,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`e81d0c96-995d-43cd-b021-9f8c098f7cd9`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:06:53,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:06:53,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:06:53,518::task::993::Storage.TaskManager.Task::(_decref) Task=`e81d0c96-995d-43cd-b021-9f8c098f7cd9`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:06:53,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`509354d2-8f69-4813-9e26-442428b20505`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:06:53,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:06:53,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:06:53,519::task::1191::Storage.TaskManager.Task::(prepare) Task=`509354d2-8f69-4813-9e26-442428b20505`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:06:53,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`509354d2-8f69-4813-9e26-442428b20505`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:06:53,519::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:06:53,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:06:53,519::task::993::Storage.TaskManager.Task::(_decref) Task=`509354d2-8f69-4813-9e26-442428b20505`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:06:53,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`51f2f443-cba0-4dea-a314-d5684378b5e9`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:06:53,520::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:06:53,520::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:06:53,521::task::1191::Storage.TaskManager.Task::(prepare) Task=`51f2f443-cba0-4dea-a314-d5684378b5e9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:06:53,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`51f2f443-cba0-4dea-a314-d5684378b5e9`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:06:53,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:06:53,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:06:53,521::task::993::Storage.TaskManager.Task::(_decref) Task=`51f2f443-cba0-4dea-a314-d5684378b5e9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-12 15:06:53,627::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::DEBUG::2014-08-12 15:06:54,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d38c579-e93c-486b-b8e6-376fc85b7a7b`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:06:54,507::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:06:54,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681229', 'lastCheck': '9.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759547', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:06:54,507::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d38c579-e93c-486b-b8e6-376fc85b7a7b`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681229', 'lastCheck': '9.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759547', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:06:54,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d38c579-e93c-486b-b8e6-376fc85b7a7b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:06:54,508::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:06:54,508::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:06:54,508::task::993::Storage.TaskManager.Task::(_decref) Task=`9d38c579-e93c-486b-b8e6-376fc85b7a7b`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:06:54,530::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-16::DEBUG::2014-08-12 15:06:54,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:06:54,767::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720363 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:06:54,771::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:54,771::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:06:54,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:54,771::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:54,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:54,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:54,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:54,772::__init__::225::IOProcess::(_processLogs) (14330) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:54,772::__init__::225::IOProcess::(_processLogs) (14330) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:54,772::__init__::225::IOProcess::(_processLogs) (14330) Building response >Thread-25::DEBUG::2014-08-12 15:06:54,772::__init__::225::IOProcess::(_processLogs) (14330) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:54,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:54,773::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:06:54,773::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:06:54,774::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:06:54,774::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:06:54,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:06:54,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:06:54,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:06:54,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:06:54,775::__init__::225::IOProcess::(_processLogs) (14331) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:06:54,775::__init__::225::IOProcess::(_processLogs) (14331) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:06:54,775::__init__::225::IOProcess::(_processLogs) (14331) Building response >Thread-25::DEBUG::2014-08-12 15:06:54,775::__init__::225::IOProcess::(_processLogs) (14331) Queuing response >Thread-25::DEBUG::2014-08-12 15:06:54,775::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:06:54,775::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:06:54,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:55,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122109 s, 83.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:06:55,528::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:06:55,541::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000929158 s, 4.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:56,230::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:56,231::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:06:56,247::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:06:57,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:57,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0208901 s, 49.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:06:59,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:06:59,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120767 s, 84.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:07:00,762::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:07:00,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3de0175-526c-49b8-b4a9-6c5c5e959f9a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:00,763::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:07:00,775::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:00,776::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3de0175-526c-49b8-b4a9-6c5c5e959f9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:00,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3de0175-526c-49b8-b4a9-6c5c5e959f9a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:00,776::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:00,776::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:00,776::task::993::Storage.TaskManager.Task::(_decref) Task=`b3de0175-526c-49b8-b4a9-6c5c5e959f9a`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:07:00,789::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:07:00,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`44317ae4-a1b4-4a52-88dc-20e50626d3b8`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:07:00,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:07:00,790::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`198c6d34-b82e-4e8b-90de-68a201b3e682`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:07:00,790::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:07:00,790::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:07:00,790::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`198c6d34-b82e-4e8b-90de-68a201b3e682`::Granted request >Thread-32::DEBUG::2014-08-12 15:07:00,791::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`44317ae4-a1b4-4a52-88dc-20e50626d3b8`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:07:00,791::task::993::Storage.TaskManager.Task::(_decref) Task=`44317ae4-a1b4-4a52-88dc-20e50626d3b8`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:07:00,804::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:00,804::task::1191::Storage.TaskManager.Task::(prepare) Task=`44317ae4-a1b4-4a52-88dc-20e50626d3b8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:00,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`44317ae4-a1b4-4a52-88dc-20e50626d3b8`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:07:00,805::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:07:00,805::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:07:00,805::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:07:00,805::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:07:00,805::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:07:00,805::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:07:00,806::task::993::Storage.TaskManager.Task::(_decref) Task=`44317ae4-a1b4-4a52-88dc-20e50626d3b8`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:01,253::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:01,254::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:01,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:01,276::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:01,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120774 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:03,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:03,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120985 s, 84.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:07:04,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:07:04,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620617 s, 6.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:07:04,792::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:07:04,792::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:07:04,792::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:04,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:04,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:04,793::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:04,793::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:04,793::__init__::225::IOProcess::(_processLogs) (14332) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:04,793::__init__::225::IOProcess::(_processLogs) (14332) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:04,794::__init__::225::IOProcess::(_processLogs) (14332) Building response >Thread-25::DEBUG::2014-08-12 15:07:04,794::__init__::225::IOProcess::(_processLogs) (14332) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:04,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:04,794::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:07:04,795::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:07:04,795::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:07:04,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:04,795::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:04,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:04,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:04,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:04,796::__init__::225::IOProcess::(_processLogs) (14333) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:04,796::__init__::225::IOProcess::(_processLogs) (14333) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:04,796::__init__::225::IOProcess::(_processLogs) (14333) Building response >Thread-25::DEBUG::2014-08-12 15:07:04,796::__init__::225::IOProcess::(_processLogs) (14333) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:04,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:04,797::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:07:05,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:05,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120059 s, 85.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:07:05,542::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:07:05,554::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622797 s, 6.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:06,283::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:06,284::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:06,300::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:07,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:07,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120999 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:09,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:09,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119715 s, 85.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:07:09,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`1186b90b-6ce4-48ba-bd22-9e4f54648166`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:09,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:07:09,627::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620617', 'lastCheck': '4.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622797', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:07:09,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`1186b90b-6ce4-48ba-bd22-9e4f54648166`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620617', 'lastCheck': '4.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622797', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:07:09,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`1186b90b-6ce4-48ba-bd22-9e4f54648166`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:09,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:09,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:09,628::task::993::Storage.TaskManager.Task::(_decref) Task=`1186b90b-6ce4-48ba-bd22-9e4f54648166`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:07:09,649::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:07:10,821::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [64529f32] >Thread-14::DEBUG::2014-08-12 15:07:10,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fe831ac-2d46-48d3-8c9d-56de870ba80f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:10,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:07:10,833::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:10,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fe831ac-2d46-48d3-8c9d-56de870ba80f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:10,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fe831ac-2d46-48d3-8c9d-56de870ba80f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:10,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:10,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:10,834::task::993::Storage.TaskManager.Task::(_decref) Task=`9fe831ac-2d46-48d3-8c9d-56de870ba80f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:07:10,846::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [64529f32] >Thread-32::DEBUG::2014-08-12 15:07:10,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`948ca382-e31b-44b4-889a-fd1f94fd01bd`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:07:10,846::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:07:10,847::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`0cce0012-2e67-43f0-966c-982d569c75c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:07:10,847::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:07:10,847::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:07:10,847::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`0cce0012-2e67-43f0-966c-982d569c75c5`::Granted request >Thread-32::DEBUG::2014-08-12 15:07:10,848::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`948ca382-e31b-44b4-889a-fd1f94fd01bd`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:07:10,848::task::993::Storage.TaskManager.Task::(_decref) Task=`948ca382-e31b-44b4-889a-fd1f94fd01bd`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:07:10,861::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:10,861::task::1191::Storage.TaskManager.Task::(prepare) Task=`948ca382-e31b-44b4-889a-fd1f94fd01bd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:10,861::task::595::Storage.TaskManager.Task::(_updateState) Task=`948ca382-e31b-44b4-889a-fd1f94fd01bd`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:07:10,861::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:07:10,861::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:07:10,862::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:07:10,862::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:07:10,862::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:07:10,862::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:07:10,862::task::993::Storage.TaskManager.Task::(_decref) Task=`948ca382-e31b-44b4-889a-fd1f94fd01bd`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:11,306::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:11,307::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:11,311::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:11,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:11,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012084 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:13,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:13,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119503 s, 85.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:07:14,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:07:14,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599285 s, 6.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:07:14,814::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:07:14,814::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:07:14,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:14,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:14,814::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:14,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:14,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:14,815::__init__::225::IOProcess::(_processLogs) (14334) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:14,815::__init__::225::IOProcess::(_processLogs) (14334) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:14,815::__init__::225::IOProcess::(_processLogs) (14334) Building response >Thread-25::DEBUG::2014-08-12 15:07:14,815::__init__::225::IOProcess::(_processLogs) (14334) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:14,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:14,816::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:07:14,816::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:07:14,816::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:07:14,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:14,817::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:14,817::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:14,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:14,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:14,817::__init__::225::IOProcess::(_processLogs) (14335) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:14,818::__init__::225::IOProcess::(_processLogs) (14335) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:14,818::__init__::225::IOProcess::(_processLogs) (14335) Building response >Thread-25::DEBUG::2014-08-12 15:07:14,818::__init__::225::IOProcess::(_processLogs) (14335) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:14,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:14,818::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:07:15,555::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:07:15,566::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000561315 s, 7.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:15,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:15,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123259 s, 83.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:16,319::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:16,323::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:16,331::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:17,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:17,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012003 s, 85.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:19,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:19,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119737 s, 85.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:07:20,879::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:07:20,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`0968ffee-a885-4936-974a-b6c162002905`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:20,880::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:07:20,892::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:20,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`0968ffee-a885-4936-974a-b6c162002905`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:20,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`0968ffee-a885-4936-974a-b6c162002905`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:20,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:20,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:20,893::task::993::Storage.TaskManager.Task::(_decref) Task=`0968ffee-a885-4936-974a-b6c162002905`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:07:20,904::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:07:20,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`c784a030-2564-4499-b2e7-0fefb750d236`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:07:20,905::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:07:20,905::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`329d26a8-3b45-45ad-8480-e531b2f258b4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:07:20,906::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:07:20,906::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:07:20,906::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`329d26a8-3b45-45ad-8480-e531b2f258b4`::Granted request >Thread-32::DEBUG::2014-08-12 15:07:20,906::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c784a030-2564-4499-b2e7-0fefb750d236`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:07:20,907::task::993::Storage.TaskManager.Task::(_decref) Task=`c784a030-2564-4499-b2e7-0fefb750d236`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:07:20,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:20,919::task::1191::Storage.TaskManager.Task::(prepare) Task=`c784a030-2564-4499-b2e7-0fefb750d236`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:20,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`c784a030-2564-4499-b2e7-0fefb750d236`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:07:20,920::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:07:20,920::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:07:20,920::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:07:20,920::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:07:20,920::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:07:20,921::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:07:20,921::task::993::Storage.TaskManager.Task::(_decref) Task=`c784a030-2564-4499-b2e7-0fefb750d236`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:21,339::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:21,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:21,346::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:21,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:22,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123551 s, 82.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:07:23,691::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:07:24,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:24,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125925 s, 81.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:07:24,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`862f36ee-3d42-41c9-8e1f-0b5eb2a1f89e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:24,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:07:24,741::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599285', 'lastCheck': '9.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561315', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:07:24,741::task::1191::Storage.TaskManager.Task::(prepare) Task=`862f36ee-3d42-41c9-8e1f-0b5eb2a1f89e`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599285', 'lastCheck': '9.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561315', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:07:24,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`862f36ee-3d42-41c9-8e1f-0b5eb2a1f89e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:24,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:24,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:24,742::task::993::Storage.TaskManager.Task::(_decref) Task=`862f36ee-3d42-41c9-8e1f-0b5eb2a1f89e`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:07:24,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-16::DEBUG::2014-08-12 15:07:24,820::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:07:24,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682754 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:07:24,834::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:07:24,834::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:07:24,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:24,835::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:24,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:24,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:24,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:24,835::__init__::225::IOProcess::(_processLogs) (14336) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:24,836::__init__::225::IOProcess::(_processLogs) (14336) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:24,836::__init__::225::IOProcess::(_processLogs) (14336) Building response >Thread-25::DEBUG::2014-08-12 15:07:24,836::__init__::225::IOProcess::(_processLogs) (14336) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:24,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:24,836::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:07:24,837::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:07:24,837::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:07:24,837::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:24,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:24,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:24,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:24,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:24,838::__init__::225::IOProcess::(_processLogs) (14337) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:24,838::__init__::225::IOProcess::(_processLogs) (14337) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:24,838::__init__::225::IOProcess::(_processLogs) (14337) Building response >Thread-25::DEBUG::2014-08-12 15:07:24,839::__init__::225::IOProcess::(_processLogs) (14337) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:24,839::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:24,839::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:07:25,567::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:07:25,579::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648874 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:26,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:26,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137148 s, 74.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:26,353::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:26,354::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:26,370::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:28,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:28,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137346 s, 74.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:30,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:30,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121473 s, 84.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:07:30,939::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:07:30,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec4cbbb5-7372-4193-932a-9268556236c9`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:30,939::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:07:30,951::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:30,952::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec4cbbb5-7372-4193-932a-9268556236c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:30,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec4cbbb5-7372-4193-932a-9268556236c9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:30,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:30,952::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:30,953::task::993::Storage.TaskManager.Task::(_decref) Task=`ec4cbbb5-7372-4193-932a-9268556236c9`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:07:30,967::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:07:30,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e7ac3ff-d08d-4fc7-a0c5-43f47cde22bb`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:07:30,967::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:07:30,968::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a2091d0a-fc59-44be-82a4-8dc9ecf5c350`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:07:30,968::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:07:30,968::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:07:30,968::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a2091d0a-fc59-44be-82a4-8dc9ecf5c350`::Granted request >Thread-32::DEBUG::2014-08-12 15:07:30,969::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8e7ac3ff-d08d-4fc7-a0c5-43f47cde22bb`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:07:30,969::task::993::Storage.TaskManager.Task::(_decref) Task=`8e7ac3ff-d08d-4fc7-a0c5-43f47cde22bb`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:07:30,982::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:30,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e7ac3ff-d08d-4fc7-a0c5-43f47cde22bb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:30,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e7ac3ff-d08d-4fc7-a0c5-43f47cde22bb`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:07:30,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:07:30,982::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:07:30,983::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:07:30,983::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:07:30,983::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:07:30,983::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:07:30,983::task::993::Storage.TaskManager.Task::(_decref) Task=`8e7ac3ff-d08d-4fc7-a0c5-43f47cde22bb`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:31,377::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:31,378::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:31,387::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:32,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:32,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120721 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:34,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:34,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122796 s, 83.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:07:34,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:07:34,852::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000769194 s, 5.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:07:34,855::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:07:34,855::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:07:34,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:34,855::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:34,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:34,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:34,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:34,856::__init__::225::IOProcess::(_processLogs) (14338) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:34,856::__init__::225::IOProcess::(_processLogs) (14338) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:34,856::__init__::225::IOProcess::(_processLogs) (14338) Building response >Thread-25::DEBUG::2014-08-12 15:07:34,857::__init__::225::IOProcess::(_processLogs) (14338) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:34,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:34,857::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:07:34,858::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:07:34,858::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:07:34,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:34,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:34,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:34,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:34,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:34,859::__init__::225::IOProcess::(_processLogs) (14339) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:34,859::__init__::225::IOProcess::(_processLogs) (14339) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:34,859::__init__::225::IOProcess::(_processLogs) (14339) Building response >Thread-25::DEBUG::2014-08-12 15:07:34,859::__init__::225::IOProcess::(_processLogs) (14339) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:34,860::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:07:35,581::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:07:35,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619136 s, 6.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:36,394::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:36,395::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:36,418::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:36,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:36,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122282 s, 83.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:38,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:38,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123108 s, 83.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:07:39,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`2571712b-7050-4bc2-b1fc-8624de08fe6c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:39,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:07:39,867::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769194', 'lastCheck': '5.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619136', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:07:39,868::task::1191::Storage.TaskManager.Task::(prepare) Task=`2571712b-7050-4bc2-b1fc-8624de08fe6c`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769194', 'lastCheck': '5.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619136', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:07:39,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`2571712b-7050-4bc2-b1fc-8624de08fe6c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:39,868::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:39,868::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:39,868::task::993::Storage.TaskManager.Task::(_decref) Task=`2571712b-7050-4bc2-b1fc-8624de08fe6c`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:07:39,892::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:40,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:40,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122279 s, 83.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:07:41,000::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:07:41,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`580a2058-8bb0-4467-a5b5-ab034ff6c27d`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:41,001::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:07:41,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:41,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`580a2058-8bb0-4467-a5b5-ab034ff6c27d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:41,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`580a2058-8bb0-4467-a5b5-ab034ff6c27d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:41,034::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:41,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:41,035::task::993::Storage.TaskManager.Task::(_decref) Task=`580a2058-8bb0-4467-a5b5-ab034ff6c27d`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:07:41,046::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:07:41,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca53a669-a8c1-4b14-90ff-2b7e562c7a54`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:07:41,046::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:07:41,047::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`faeed90f-2e2c-49a3-bb63-ea7391af1b92`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:07:41,047::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:07:41,047::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:07:41,048::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`faeed90f-2e2c-49a3-bb63-ea7391af1b92`::Granted request >Thread-32::DEBUG::2014-08-12 15:07:41,048::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ca53a669-a8c1-4b14-90ff-2b7e562c7a54`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:07:41,048::task::993::Storage.TaskManager.Task::(_decref) Task=`ca53a669-a8c1-4b14-90ff-2b7e562c7a54`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:07:41,061::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:41,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca53a669-a8c1-4b14-90ff-2b7e562c7a54`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:41,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca53a669-a8c1-4b14-90ff-2b7e562c7a54`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:07:41,061::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:07:41,061::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:07:41,062::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:07:41,062::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:07:41,062::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:07:41,062::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:07:41,063::task::993::Storage.TaskManager.Task::(_decref) Task=`ca53a669-a8c1-4b14-90ff-2b7e562c7a54`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:41,425::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:41,426::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:41,434::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:42,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:42,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122536 s, 83.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:44,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:44,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120031 s, 85.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:07:44,861::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:07:44,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601622 s, 6.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:07:44,877::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:07:44,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:44,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:44,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:44,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:44,877::__init__::225::IOProcess::(_processLogs) (14340) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:44,878::__init__::225::IOProcess::(_processLogs) (14340) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:44,878::__init__::225::IOProcess::(_processLogs) (14340) Building response >Thread-25::DEBUG::2014-08-12 15:07:44,878::__init__::225::IOProcess::(_processLogs) (14340) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:44,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:44,878::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:07:44,879::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:07:44,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:44,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:44,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:44,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:44,880::__init__::225::IOProcess::(_processLogs) (14341) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:44,880::__init__::225::IOProcess::(_processLogs) (14341) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:44,880::__init__::225::IOProcess::(_processLogs) (14341) Building response >Thread-25::DEBUG::2014-08-12 15:07:44,880::__init__::225::IOProcess::(_processLogs) (14341) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:44,881::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:44,881::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:07:45,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:07:45,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599359 s, 6.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:46,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:46,446::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:46,448::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:46,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:46,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012316 s, 83.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:48,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:48,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0165283 s, 62.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:51,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:51,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120771 s, 84.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:07:51,078::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:07:51,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e4830a0-77fc-4efb-aec7-697e00d46ab9`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:51,081::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:07:51,116::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:51,117::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e4830a0-77fc-4efb-aec7-697e00d46ab9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:07:51,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e4830a0-77fc-4efb-aec7-697e00d46ab9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:51,117::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:51,117::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:51,117::task::993::Storage.TaskManager.Task::(_decref) Task=`1e4830a0-77fc-4efb-aec7-697e00d46ab9`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:07:51,129::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:07:51,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`f981d25a-9975-4327-8c18-e2a92e45f71e`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:07:51,129::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:07:51,130::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`65a586bb-26d1-4602-9832-ca350e6f05b3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:07:51,130::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:07:51,130::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:07:51,131::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`65a586bb-26d1-4602-9832-ca350e6f05b3`::Granted request >Thread-32::DEBUG::2014-08-12 15:07:51,131::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f981d25a-9975-4327-8c18-e2a92e45f71e`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:07:51,131::task::993::Storage.TaskManager.Task::(_decref) Task=`f981d25a-9975-4327-8c18-e2a92e45f71e`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:07:51,144::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:51,144::task::1191::Storage.TaskManager.Task::(prepare) Task=`f981d25a-9975-4327-8c18-e2a92e45f71e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:07:51,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`f981d25a-9975-4327-8c18-e2a92e45f71e`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:07:51,144::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:07:51,144::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:07:51,145::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:07:51,145::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:07:51,145::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:07:51,145::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:07:51,145::task::993::Storage.TaskManager.Task::(_decref) Task=`f981d25a-9975-4327-8c18-e2a92e45f71e`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:51,456::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:51,457::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:51,463::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:53,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:53,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120865 s, 84.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:07:53,735::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-44::DEBUG::2014-08-12 15:07:54,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f0f33d0-ec50-4b2d-b3ee-714470993810`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:07:54,547::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:07:54,548::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:07:54,548::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f0f33d0-ec50-4b2d-b3ee-714470993810`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:07:54,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f0f33d0-ec50-4b2d-b3ee-714470993810`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:07:54,548::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:07:54,549::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:07:54,549::task::993::Storage.TaskManager.Task::(_decref) Task=`7f0f33d0-ec50-4b2d-b3ee-714470993810`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:07:54,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5b77532-6509-4900-abcf-415479be0240`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:07:54,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:07:54,549::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:07:54,550::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5b77532-6509-4900-abcf-415479be0240`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:07:54,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5b77532-6509-4900-abcf-415479be0240`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:07:54,550::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:07:54,550::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:07:54,550::task::993::Storage.TaskManager.Task::(_decref) Task=`f5b77532-6509-4900-abcf-415479be0240`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:07:54,551::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d60911a-f154-4b4b-839c-4103822f5741`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:07:54,551::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:07:54,551::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:07:54,551::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d60911a-f154-4b4b-839c-4103822f5741`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:07:54,551::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d60911a-f154-4b4b-839c-4103822f5741`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:07:54,551::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:07:54,552::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:07:54,552::task::993::Storage.TaskManager.Task::(_decref) Task=`8d60911a-f154-4b4b-839c-4103822f5741`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:07:54,552::task::595::Storage.TaskManager.Task::(_updateState) Task=`eea745cd-21bc-404c-ac1d-f7945814b3b3`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:07:54,552::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:07:54,553::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:07:54,553::task::1191::Storage.TaskManager.Task::(prepare) Task=`eea745cd-21bc-404c-ac1d-f7945814b3b3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:07:54,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`eea745cd-21bc-404c-ac1d-f7945814b3b3`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:07:54,553::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:07:54,553::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:07:54,553::task::993::Storage.TaskManager.Task::(_decref) Task=`eea745cd-21bc-404c-ac1d-f7945814b3b3`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:07:54,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:07:54,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662957 s, 6.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:07:54,897::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:07:54,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:07:54,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:54,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:54,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:54,898::__init__::225::IOProcess::(_processLogs) (14342) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:54,898::__init__::225::IOProcess::(_processLogs) (14342) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:54,898::__init__::225::IOProcess::(_processLogs) (14342) Building response >Thread-25::DEBUG::2014-08-12 15:07:54,899::__init__::225::IOProcess::(_processLogs) (14342) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:54,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:07:54,899::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:07:54,902::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:07:54,902::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:07:54,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:07:54,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:07:54,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:07:54,903::__init__::225::IOProcess::(_processLogs) (14343) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:07:54,903::__init__::225::IOProcess::(_processLogs) (14343) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:07:54,903::__init__::225::IOProcess::(_processLogs) (14343) Building response >Thread-25::DEBUG::2014-08-12 15:07:54,903::__init__::225::IOProcess::(_processLogs) (14343) Queuing response >Thread-25::DEBUG::2014-08-12 15:07:54,903::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:07:55,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dc66229-af2c-4491-bcae-b794b3e23f0d`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:07:55,022::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:07:55,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662957', 'lastCheck': '0.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599359', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:07:55,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`7dc66229-af2c-4491-bcae-b794b3e23f0d`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662957', 'lastCheck': '0.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599359', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:07:55,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dc66229-af2c-4491-bcae-b794b3e23f0d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:07:55,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:07:55,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:07:55,023::task::993::Storage.TaskManager.Task::(_decref) Task=`7dc66229-af2c-4491-bcae-b794b3e23f0d`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:07:55,050::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:55,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:55,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121339 s, 84.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:07:55,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:07:55,619::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664555 s, 6.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:56,467::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:56,468::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:07:56,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:07:57,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:57,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120412 s, 85.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:07:59,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:07:59,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118998 s, 86.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:08:01,161::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:08:01,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`2eac2a63-5707-4e29-a88b-74192836209f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:01,162::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:08:01,189::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:01,189::task::1191::Storage.TaskManager.Task::(prepare) Task=`2eac2a63-5707-4e29-a88b-74192836209f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:01,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`2eac2a63-5707-4e29-a88b-74192836209f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:01,190::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:01,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:01,190::task::993::Storage.TaskManager.Task::(_decref) Task=`2eac2a63-5707-4e29-a88b-74192836209f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:08:01,201::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:08:01,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbad848f-3ce0-4acd-ae42-b0d50ed1295f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:08:01,202::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:08:01,202::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8eed5365-e94f-49e1-ad3e-9571185b53ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:08:01,202::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:08:01,203::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:08:01,203::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8eed5365-e94f-49e1-ad3e-9571185b53ee`::Granted request >Thread-32::DEBUG::2014-08-12 15:08:01,203::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dbad848f-3ce0-4acd-ae42-b0d50ed1295f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:08:01,203::task::993::Storage.TaskManager.Task::(_decref) Task=`dbad848f-3ce0-4acd-ae42-b0d50ed1295f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:08:01,216::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:01,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`dbad848f-3ce0-4acd-ae42-b0d50ed1295f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:01,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbad848f-3ce0-4acd-ae42-b0d50ed1295f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:08:01,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:08:01,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:08:01,217::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:08:01,217::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:08:01,217::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:08:01,217::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:08:01,217::task::993::Storage.TaskManager.Task::(_decref) Task=`dbad848f-3ce0-4acd-ae42-b0d50ed1295f`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:08:01,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:01,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121226 s, 84.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:01,489::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:01,490::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:01,498::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:03,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:03,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122821 s, 83.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:08:04,905::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:08:04,916::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765856 s, 5.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:08:04,919::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:08:04,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:04,920::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:08:04,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:04,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:04,920::__init__::225::IOProcess::(_processLogs) (14344) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:04,920::__init__::225::IOProcess::(_processLogs) (14344) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:04,920::__init__::225::IOProcess::(_processLogs) (14344) Building response >Thread-25::DEBUG::2014-08-12 15:08:04,920::__init__::225::IOProcess::(_processLogs) (14344) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:04,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:04,921::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:08:04,922::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:08:04,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:04,922::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:04,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:04,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:04,922::__init__::225::IOProcess::(_processLogs) (14345) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:04,923::__init__::225::IOProcess::(_processLogs) (14345) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:04,923::__init__::225::IOProcess::(_processLogs) (14345) Building response >Thread-25::DEBUG::2014-08-12 15:08:04,923::__init__::225::IOProcess::(_processLogs) (14345) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:04,923::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:04,923::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:08:05,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:05,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123906 s, 82.6 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:08:05,621::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:08:05,632::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603249 s, 6.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:06,505::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:06,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:06,531::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:07,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:07,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.019586 s, 52.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:09,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:09,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121502 s, 84.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:08:10,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`1153bab8-1da4-468a-ae9c-09e25985f4ba`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:10,212::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:08:10,218::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765856', 'lastCheck': '5.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603249', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:08:10,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`1153bab8-1da4-468a-ae9c-09e25985f4ba`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765856', 'lastCheck': '5.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603249', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:08:10,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`1153bab8-1da4-468a-ae9c-09e25985f4ba`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:10,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:10,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:10,219::task::993::Storage.TaskManager.Task::(_decref) Task=`1153bab8-1da4-468a-ae9c-09e25985f4ba`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:08:10,243::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:08:11,248::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [40e0fb6b] >Thread-14::DEBUG::2014-08-12 15:08:11,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`db3c84a4-a9e9-46fe-a40c-133f9acfad85`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:11,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:08:11,273::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:11,273::task::1191::Storage.TaskManager.Task::(prepare) Task=`db3c84a4-a9e9-46fe-a40c-133f9acfad85`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:11,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`db3c84a4-a9e9-46fe-a40c-133f9acfad85`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:11,273::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:11,273::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:11,273::task::993::Storage.TaskManager.Task::(_decref) Task=`db3c84a4-a9e9-46fe-a40c-133f9acfad85`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:08:11,290::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [40e0fb6b] >Thread-32::DEBUG::2014-08-12 15:08:11,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`f82741a6-5e0a-4997-8513-8b2f8871e0e8`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:08:11,291::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:08:11,292::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d25f8bbf-8c1c-435d-9935-bbc0301f8b2a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:08:11,292::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:08:11,292::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:08:11,293::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d25f8bbf-8c1c-435d-9935-bbc0301f8b2a`::Granted request >Thread-32::DEBUG::2014-08-12 15:08:11,293::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f82741a6-5e0a-4997-8513-8b2f8871e0e8`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:08:11,293::task::993::Storage.TaskManager.Task::(_decref) Task=`f82741a6-5e0a-4997-8513-8b2f8871e0e8`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:08:11,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:11,307::task::1191::Storage.TaskManager.Task::(prepare) Task=`f82741a6-5e0a-4997-8513-8b2f8871e0e8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:11,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`f82741a6-5e0a-4997-8513-8b2f8871e0e8`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:08:11,307::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:08:11,307::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:08:11,307::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:08:11,308::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:08:11,308::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:08:11,308::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:08:11,308::task::993::Storage.TaskManager.Task::(_decref) Task=`f82741a6-5e0a-4997-8513-8b2f8871e0e8`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:11,537::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:11,539::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:11,552::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:11,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:11,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121261 s, 84.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:13,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:13,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119592 s, 85.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:08:14,924::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:08:14,936::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672226 s, 6.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:08:14,940::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:08:14,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:14,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:14,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:14,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:14,942::__init__::225::IOProcess::(_processLogs) (14346) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:14,943::__init__::225::IOProcess::(_processLogs) (14346) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:14,943::__init__::225::IOProcess::(_processLogs) (14346) Building response >Thread-25::DEBUG::2014-08-12 15:08:14,943::__init__::225::IOProcess::(_processLogs) (14346) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:14,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:14,943::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:08:14,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:14,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:08:14,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:14,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:14,945::__init__::225::IOProcess::(_processLogs) (14347) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:14,945::__init__::225::IOProcess::(_processLogs) (14347) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:14,945::__init__::225::IOProcess::(_processLogs) (14347) Building response >Thread-25::DEBUG::2014-08-12 15:08:14,946::__init__::225::IOProcess::(_processLogs) (14347) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:14,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:14,946::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:08:15,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:08:15,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657263 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:15,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:15,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0191678 s, 53.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:16,560::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:16,565::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:16,572::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:18,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:18,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013283 s, 77.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:20,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:20,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131595 s, 77.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:08:21,330::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:08:21,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff74d10e-a8bf-4651-b0b4-a8ad354b5538`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:21,331::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:08:21,342::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:21,343::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff74d10e-a8bf-4651-b0b4-a8ad354b5538`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:21,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff74d10e-a8bf-4651-b0b4-a8ad354b5538`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:21,343::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:21,343::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:21,343::task::993::Storage.TaskManager.Task::(_decref) Task=`ff74d10e-a8bf-4651-b0b4-a8ad354b5538`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:08:21,363::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:08:21,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4fe5825-58f1-45c2-87c5-c333ce96ed16`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:08:21,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:08:21,365::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`83131ade-fce6-45a5-9feb-012995bec748`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:08:21,365::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:08:21,365::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:08:21,365::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`83131ade-fce6-45a5-9feb-012995bec748`::Granted request >Thread-32::DEBUG::2014-08-12 15:08:21,366::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d4fe5825-58f1-45c2-87c5-c333ce96ed16`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:08:21,366::task::993::Storage.TaskManager.Task::(_decref) Task=`d4fe5825-58f1-45c2-87c5-c333ce96ed16`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:08:21,378::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:21,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4fe5825-58f1-45c2-87c5-c333ce96ed16`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:21,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4fe5825-58f1-45c2-87c5-c333ce96ed16`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:08:21,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:08:21,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:08:21,379::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:08:21,379::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:08:21,380::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:08:21,380::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:08:21,380::task::993::Storage.TaskManager.Task::(_decref) Task=`d4fe5825-58f1-45c2-87c5-c333ce96ed16`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:21,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:21,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:21,587::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:22,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:22,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130637 s, 78.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:08:23,773::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:08:24,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:24,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131453 s, 77.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:08:24,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:08:24,960::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814785 s, 5.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:08:24,963::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:08:24,963::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:24,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:24,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:24,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:24,964::__init__::225::IOProcess::(_processLogs) (14348) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:24,964::__init__::225::IOProcess::(_processLogs) (14348) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:24,964::__init__::225::IOProcess::(_processLogs) (14348) Building response >Thread-25::DEBUG::2014-08-12 15:08:24,964::__init__::225::IOProcess::(_processLogs) (14348) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:24,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:24,965::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:08:24,965::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:08:24,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:24,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:24,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:24,966::__init__::225::IOProcess::(_processLogs) (14349) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:24,966::__init__::225::IOProcess::(_processLogs) (14349) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:24,966::__init__::225::IOProcess::(_processLogs) (14349) Building response >Thread-25::DEBUG::2014-08-12 15:08:24,966::__init__::225::IOProcess::(_processLogs) (14349) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:24,967::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:24,967::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:08:25,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbb8e715-83f1-41ea-b3e7-2fed293252d0`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:25,351::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:08:25,351::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814785', 'lastCheck': '0.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657263', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:08:25,352::task::1191::Storage.TaskManager.Task::(prepare) Task=`dbb8e715-83f1-41ea-b3e7-2fed293252d0`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814785', 'lastCheck': '0.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657263', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:08:25,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbb8e715-83f1-41ea-b3e7-2fed293252d0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:25,352::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:25,352::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:25,352::task::993::Storage.TaskManager.Task::(_decref) Task=`dbb8e715-83f1-41ea-b3e7-2fed293252d0`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:08:25,375::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-33::DEBUG::2014-08-12 15:08:25,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:08:25,661::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799921 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:26,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:26,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130616 s, 78.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:26,594::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:26,595::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:26,611::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:28,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:28,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131898 s, 77.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:30,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:30,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132373 s, 77.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:08:31,404::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:08:31,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`ecca90b1-1b77-4034-ac85-85399ffd4109`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:31,405::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:08:31,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:31,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`ecca90b1-1b77-4034-ac85-85399ffd4109`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:31,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`ecca90b1-1b77-4034-ac85-85399ffd4109`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:31,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:31,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:31,418::task::993::Storage.TaskManager.Task::(_decref) Task=`ecca90b1-1b77-4034-ac85-85399ffd4109`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:08:31,434::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:08:31,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b7c34b8-318b-4856-a446-1dfe9a85f3fb`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:08:31,437::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:08:31,438::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`4505bbf4-3692-42e9-94cc-4ebfa063be2a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:08:31,438::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:08:31,438::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:08:31,438::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`4505bbf4-3692-42e9-94cc-4ebfa063be2a`::Granted request >Thread-32::DEBUG::2014-08-12 15:08:31,439::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5b7c34b8-318b-4856-a446-1dfe9a85f3fb`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:08:31,439::task::993::Storage.TaskManager.Task::(_decref) Task=`5b7c34b8-318b-4856-a446-1dfe9a85f3fb`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:08:31,451::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:31,452::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b7c34b8-318b-4856-a446-1dfe9a85f3fb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:31,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b7c34b8-318b-4856-a446-1dfe9a85f3fb`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:08:31,452::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:08:31,452::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:08:31,452::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:08:31,453::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:08:31,453::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:08:31,453::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:08:31,453::task::993::Storage.TaskManager.Task::(_decref) Task=`5b7c34b8-318b-4856-a446-1dfe9a85f3fb`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:31,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:31,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:31,628::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:32,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:32,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132262 s, 77.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:34,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:34,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319788 s, 32.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:08:34,968::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:08:34,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063381 s, 6.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:08:34,982::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:08:34,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:34,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:34,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:34,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:34,983::__init__::225::IOProcess::(_processLogs) (14350) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:34,983::__init__::225::IOProcess::(_processLogs) (14350) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:34,984::__init__::225::IOProcess::(_processLogs) (14350) Building response >Thread-25::DEBUG::2014-08-12 15:08:34,984::__init__::225::IOProcess::(_processLogs) (14350) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:34,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:34,984::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:08:34,985::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:08:34,985::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:08:34,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:34,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:34,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:34,986::__init__::225::IOProcess::(_processLogs) (14351) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:34,986::__init__::225::IOProcess::(_processLogs) (14351) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:34,986::__init__::225::IOProcess::(_processLogs) (14351) Building response >Thread-25::DEBUG::2014-08-12 15:08:34,986::__init__::225::IOProcess::(_processLogs) (14351) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:34,986::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:34,986::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:08:35,662::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:08:35,674::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636455 s, 6.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:36,635::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:36,636::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:36,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:36,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:36,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129987 s, 78.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:38,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:38,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130193 s, 78.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:08:40,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`9741249e-196c-4332-9192-9bd17561fc15`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:40,513::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:08:40,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063381', 'lastCheck': '5.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636455', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:08:40,515::task::1191::Storage.TaskManager.Task::(prepare) Task=`9741249e-196c-4332-9192-9bd17561fc15`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063381', 'lastCheck': '5.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636455', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:08:40,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`9741249e-196c-4332-9192-9bd17561fc15`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:40,515::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:40,515::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:40,516::task::993::Storage.TaskManager.Task::(_decref) Task=`9741249e-196c-4332-9192-9bd17561fc15`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:08:40,539::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:40,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:40,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128956 s, 79.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:08:41,470::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:08:41,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3dd2fb9-fe73-4b09-b479-d3fb93f1c595`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:41,471::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:08:41,483::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:41,483::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3dd2fb9-fe73-4b09-b479-d3fb93f1c595`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:41,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3dd2fb9-fe73-4b09-b479-d3fb93f1c595`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:41,483::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:41,483::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:41,484::task::993::Storage.TaskManager.Task::(_decref) Task=`f3dd2fb9-fe73-4b09-b479-d3fb93f1c595`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:08:41,496::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:08:41,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`77cb4071-6709-4e0b-903b-71b0d186e6b9`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:08:41,496::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:08:41,497::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`894138ab-5821-44ed-8d69-846b072276ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:08:41,497::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:08:41,497::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:08:41,498::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`894138ab-5821-44ed-8d69-846b072276ed`::Granted request >Thread-32::DEBUG::2014-08-12 15:08:41,498::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`77cb4071-6709-4e0b-903b-71b0d186e6b9`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:08:41,498::task::993::Storage.TaskManager.Task::(_decref) Task=`77cb4071-6709-4e0b-903b-71b0d186e6b9`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:08:41,510::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:41,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`77cb4071-6709-4e0b-903b-71b0d186e6b9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:41,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`77cb4071-6709-4e0b-903b-71b0d186e6b9`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:08:41,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:08:41,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:08:41,512::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:08:41,512::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:08:41,512::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:08:41,512::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:08:41,512::task::993::Storage.TaskManager.Task::(_decref) Task=`77cb4071-6709-4e0b-903b-71b0d186e6b9`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:41,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:41,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:41,675::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:42,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:42,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131736 s, 77.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:08:44,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:08:44,999::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727325 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:45,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-25::DEBUG::2014-08-12 15:08:45,004::__init__::225::IOProcess::(_processLogs) (14351) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:08:45,013::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:08:45,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:45,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:08:45,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:45,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:45,016::__init__::225::IOProcess::(_processLogs) (14351) Queuing responseDEBUG|Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:45,017::__init__::225::IOProcess::(_processLogs) (14352) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:45,017::__init__::225::IOProcess::(_processLogs) (14352) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:45,017::__init__::225::IOProcess::(_processLogs) (14352) Building response >Thread-25::DEBUG::2014-08-12 15:08:45,017::__init__::225::IOProcess::(_processLogs) (14352) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:45,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:45,017::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:08:45,019::__init__::225::IOProcess::(_processLogs) (14351) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:08:45,019::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:08:45,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:45,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:08:45,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:45,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:45,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:45,020::__init__::225::IOProcess::(_processLogs) (14353) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:45,020::__init__::225::IOProcess::(_processLogs) (14353) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:45,020::__init__::225::IOProcess::(_processLogs) (14353) Building response >Thread-25::DEBUG::2014-08-12 15:08:45,020::__init__::225::IOProcess::(_processLogs) (14353) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:45,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:45,021::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:08:45,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128124 s, 79.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:08:45,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:08:45,689::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000840181 s, 4.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:46,684::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:46,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:46,696::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:47,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:47,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129675 s, 79.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:49,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:49,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128993 s, 79.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:51,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:51,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130306 s, 78.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:08:51,529::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:08:51,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0c0ca05-d189-4537-87bf-1cdf58225f20`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:51,530::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:08:51,542::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:51,542::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0c0ca05-d189-4537-87bf-1cdf58225f20`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:08:51,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0c0ca05-d189-4537-87bf-1cdf58225f20`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:51,542::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:51,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:51,543::task::993::Storage.TaskManager.Task::(_decref) Task=`d0c0ca05-d189-4537-87bf-1cdf58225f20`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:08:51,554::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:08:51,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d30111c-fa31-4e6b-ab16-c1b02e24e71d`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:08:51,555::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:08:51,556::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f5d395d6-9663-4b32-ac2a-fa370943a4f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:08:51,556::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:08:51,556::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:08:51,556::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f5d395d6-9663-4b32-ac2a-fa370943a4f1`::Granted request >Thread-32::DEBUG::2014-08-12 15:08:51,557::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d30111c-fa31-4e6b-ab16-c1b02e24e71d`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:08:51,557::task::993::Storage.TaskManager.Task::(_decref) Task=`8d30111c-fa31-4e6b-ab16-c1b02e24e71d`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:08:51,569::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:51,569::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d30111c-fa31-4e6b-ab16-c1b02e24e71d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:08:51,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d30111c-fa31-4e6b-ab16-c1b02e24e71d`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:08:51,570::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:08:51,570::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:08:51,570::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:08:51,570::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:08:51,571::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:08:51,571::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:08:51,571::task::993::Storage.TaskManager.Task::(_decref) Task=`8d30111c-fa31-4e6b-ab16-c1b02e24e71d`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:51,704::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:51,705::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:51,710::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:53,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:53,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132601 s, 77.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:08:53,818::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-16::DEBUG::2014-08-12 15:08:55,022::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:08:55,033::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692491 s, 5.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:08:55,037::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:08:55,037::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:08:55,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:55,037::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:08:55,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:55,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:55,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:55,038::__init__::225::IOProcess::(_processLogs) (14354) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:55,038::__init__::225::IOProcess::(_processLogs) (14354) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:55,038::__init__::225::IOProcess::(_processLogs) (14354) Building response >Thread-25::DEBUG::2014-08-12 15:08:55,038::__init__::225::IOProcess::(_processLogs) (14354) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:55,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:55,039::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:08:55,040::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:08:55,040::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:08:55,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:08:55,040::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:08:55,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:08:55,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:08:55,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:08:55,041::__init__::225::IOProcess::(_processLogs) (14355) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:08:55,041::__init__::225::IOProcess::(_processLogs) (14355) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:08:55,041::__init__::225::IOProcess::(_processLogs) (14355) Building response >Thread-25::DEBUG::2014-08-12 15:08:55,041::__init__::225::IOProcess::(_processLogs) (14355) Queuing response >Thread-25::DEBUG::2014-08-12 15:08:55,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:08:55,041::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:08:55,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:55,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133144 s, 76.9 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:08:55,473::task::595::Storage.TaskManager.Task::(_updateState) Task=`65bdb6e7-8731-4074-b821-5aa74373bb2d`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:08:55,473::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:08:55,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:08:55,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`65bdb6e7-8731-4074-b821-5aa74373bb2d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:08:55,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`65bdb6e7-8731-4074-b821-5aa74373bb2d`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:08:55,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:08:55,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:08:55,475::task::993::Storage.TaskManager.Task::(_decref) Task=`65bdb6e7-8731-4074-b821-5aa74373bb2d`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:08:55,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`69fe192f-c705-4bdb-909f-a69d2a067c9e`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:08:55,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:08:55,475::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:08:55,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`69fe192f-c705-4bdb-909f-a69d2a067c9e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:08:55,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`69fe192f-c705-4bdb-909f-a69d2a067c9e`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:08:55,476::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:08:55,476::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:08:55,476::task::993::Storage.TaskManager.Task::(_decref) Task=`69fe192f-c705-4bdb-909f-a69d2a067c9e`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:08:55,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`1478ee78-9289-4fb5-a07c-36d70e6a38ac`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:08:55,477::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:08:55,477::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:08:55,477::task::1191::Storage.TaskManager.Task::(prepare) Task=`1478ee78-9289-4fb5-a07c-36d70e6a38ac`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:08:55,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`1478ee78-9289-4fb5-a07c-36d70e6a38ac`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:08:55,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:08:55,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:08:55,478::task::993::Storage.TaskManager.Task::(_decref) Task=`1478ee78-9289-4fb5-a07c-36d70e6a38ac`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:08:55,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`d76dc8a5-5b3a-4fc4-b6b8-8561591d1d02`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:08:55,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:08:55,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:08:55,479::task::1191::Storage.TaskManager.Task::(prepare) Task=`d76dc8a5-5b3a-4fc4-b6b8-8561591d1d02`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:08:55,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`d76dc8a5-5b3a-4fc4-b6b8-8561591d1d02`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:08:55,479::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:08:55,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:08:55,479::task::993::Storage.TaskManager.Task::(_decref) Task=`d76dc8a5-5b3a-4fc4-b6b8-8561591d1d02`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:08:55,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`99a06012-5fb8-466a-91a6-6b17da86c28d`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:08:55,642::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:08:55,643::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692491', 'lastCheck': '0.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000840181', 'lastCheck': '10.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:08:55,643::task::1191::Storage.TaskManager.Task::(prepare) Task=`99a06012-5fb8-466a-91a6-6b17da86c28d`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692491', 'lastCheck': '0.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000840181', 'lastCheck': '10.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:08:55,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`99a06012-5fb8-466a-91a6-6b17da86c28d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:08:55,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:08:55,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:08:55,644::task::993::Storage.TaskManager.Task::(_decref) Task=`99a06012-5fb8-466a-91a6-6b17da86c28d`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:08:55,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-33::DEBUG::2014-08-12 15:08:55,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:08:55,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673894 s, 6.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:56,717::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:56,718::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:08:56,734::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:08:57,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:57,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131017 s, 78.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:08:59,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:08:59,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133582 s, 76.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:01,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-08-12 15:09:01,599::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [175b0e4c] >Thread-14::DEBUG::2014-08-12 15:09:01,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`a280e443-a0c8-4e7b-89a6-29bbe887fbfd`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:01,600::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:09:01,648::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Dummy-31::DEBUG::2014-08-12 15:09:01,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127743 s, 80.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:09:01,649::task::1191::Storage.TaskManager.Task::(prepare) Task=`a280e443-a0c8-4e7b-89a6-29bbe887fbfd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:01,649::task::595::Storage.TaskManager.Task::(_updateState) Task=`a280e443-a0c8-4e7b-89a6-29bbe887fbfd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:01,650::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:01,650::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:01,651::task::993::Storage.TaskManager.Task::(_decref) Task=`a280e443-a0c8-4e7b-89a6-29bbe887fbfd`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:09:01,667::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [175b0e4c] >Thread-32::DEBUG::2014-08-12 15:09:01,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`d993f5cd-1eb9-457a-8e32-e647993cef66`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:09:01,670::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:09:01,672::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`15591ef0-f661-49c3-9854-8711e1112248`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:09:01,673::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:09:01,674::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:09:01,675::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`15591ef0-f661-49c3-9854-8711e1112248`::Granted request >Thread-32::DEBUG::2014-08-12 15:09:01,677::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d993f5cd-1eb9-457a-8e32-e647993cef66`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:09:01,678::task::993::Storage.TaskManager.Task::(_decref) Task=`d993f5cd-1eb9-457a-8e32-e647993cef66`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:09:01,693::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:01,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`d993f5cd-1eb9-457a-8e32-e647993cef66`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:01,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`d993f5cd-1eb9-457a-8e32-e647993cef66`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:09:01,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:09:01,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:09:01,694::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:09:01,694::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:09:01,694::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:09:01,694::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:09:01,695::task::993::Storage.TaskManager.Task::(_decref) Task=`d993f5cd-1eb9-457a-8e32-e647993cef66`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:01,740::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:01,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:01,746::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:03,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:03,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121862 s, 84.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:09:05,043::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:05,054::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757124 s, 5.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:09:05,058::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:09:05,058::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:09:05,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:05,058::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:05,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:05,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:05,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:05,059::__init__::225::IOProcess::(_processLogs) (14356) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:05,059::__init__::225::IOProcess::(_processLogs) (14356) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:05,059::__init__::225::IOProcess::(_processLogs) (14356) Building response >Thread-25::DEBUG::2014-08-12 15:09:05,059::__init__::225::IOProcess::(_processLogs) (14356) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:05,059::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:05,060::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:09:05,060::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:09:05,061::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:09:05,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:05,061::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:05,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:05,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:05,061::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:05,062::__init__::225::IOProcess::(_processLogs) (14357) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:05,062::__init__::225::IOProcess::(_processLogs) (14357) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:05,062::__init__::225::IOProcess::(_processLogs) (14357) Building response >Thread-25::DEBUG::2014-08-12 15:09:05,062::__init__::225::IOProcess::(_processLogs) (14357) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:05,062::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:05,062::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:09:05,704::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:09:05,716::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067018 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:05,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:05,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122474 s, 83.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:06,753::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:06,754::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:06,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:07,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:07,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262134 s, 39.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:09,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:10,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121081 s, 84.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:09:10,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`973001d4-4faa-4a33-a8de-35031fe2980b`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:10,772::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:09:10,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757124', 'lastCheck': '5.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067018', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:09:10,773::task::1191::Storage.TaskManager.Task::(prepare) Task=`973001d4-4faa-4a33-a8de-35031fe2980b`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757124', 'lastCheck': '5.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067018', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:09:10,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`973001d4-4faa-4a33-a8de-35031fe2980b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:10,773::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:10,773::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:10,774::task::993::Storage.TaskManager.Task::(_decref) Task=`973001d4-4faa-4a33-a8de-35031fe2980b`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:09:10,797::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:09:11,720::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:09:11,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce9194d0-c710-4e0c-b5f2-f039ae671033`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:11,721::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:09:11,733::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:11,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce9194d0-c710-4e0c-b5f2-f039ae671033`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:11,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce9194d0-c710-4e0c-b5f2-f039ae671033`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:11,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:11,733::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:11,734::task::993::Storage.TaskManager.Task::(_decref) Task=`ce9194d0-c710-4e0c-b5f2-f039ae671033`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:09:11,745::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:09:11,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ea8b89d-87f6-41e1-b3d7-fe8a611d03cb`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:09:11,745::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:09:11,746::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c4bdabca-0ab8-4f62-84af-b09c887153c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:09:11,746::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:09:11,746::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:09:11,746::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c4bdabca-0ab8-4f62-84af-b09c887153c9`::Granted request >Thread-32::DEBUG::2014-08-12 15:09:11,747::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6ea8b89d-87f6-41e1-b3d7-fe8a611d03cb`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:09:11,747::task::993::Storage.TaskManager.Task::(_decref) Task=`6ea8b89d-87f6-41e1-b3d7-fe8a611d03cb`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:09:11,759::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:11,759::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ea8b89d-87f6-41e1-b3d7-fe8a611d03cb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:11,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ea8b89d-87f6-41e1-b3d7-fe8a611d03cb`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:09:11,774::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:09:11,774::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:09:11,774::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:09:11,775::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:09:11,775::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:09:11,776::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:11,778::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-32::DEBUG::2014-08-12 15:09:11,780::task::993::Storage.TaskManager.Task::(_decref) Task=`6ea8b89d-87f6-41e1-b3d7-fe8a611d03cb`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:11,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:11,788::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:12,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:12,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123941 s, 82.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:14,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:14,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121314 s, 84.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:09:15,064::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:15,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687741 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:09:15,078::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:09:15,078::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:09:15,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:15,079::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:15,079::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:15,079::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:15,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:15,079::__init__::225::IOProcess::(_processLogs) (14358) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:15,080::__init__::225::IOProcess::(_processLogs) (14358) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:15,080::__init__::225::IOProcess::(_processLogs) (14358) Building response >Thread-25::DEBUG::2014-08-12 15:09:15,080::__init__::225::IOProcess::(_processLogs) (14358) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:15,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:15,080::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:09:15,081::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:09:15,081::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:09:15,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:15,082::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:15,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:15,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:15,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:15,082::__init__::225::IOProcess::(_processLogs) (14359) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:15,082::__init__::225::IOProcess::(_processLogs) (14359) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:15,083::__init__::225::IOProcess::(_processLogs) (14359) Building response >Thread-25::DEBUG::2014-08-12 15:09:15,083::__init__::225::IOProcess::(_processLogs) (14359) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:15,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:15,083::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:09:15,718::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:09:15,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623216 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:16,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:16,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0191014 s, 53.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:16,797::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:16,801::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:16,807::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:18,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:18,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132284 s, 77.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:20,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:20,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130403 s, 78.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:09:21,803::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:09:21,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`804b8a22-fdcc-4f18-8ada-543dc16a0506`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:21,809::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:21,816::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:21,816::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:21,817::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::INFO::2014-08-12 15:09:21,847::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:21,847::task::1191::Storage.TaskManager.Task::(prepare) Task=`804b8a22-fdcc-4f18-8ada-543dc16a0506`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:21,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`804b8a22-fdcc-4f18-8ada-543dc16a0506`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:21,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:21,847::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:21,848::task::993::Storage.TaskManager.Task::(_decref) Task=`804b8a22-fdcc-4f18-8ada-543dc16a0506`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:09:21,860::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:09:21,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`0716d26b-2ed1-4be5-8379-be99bc2caf6f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:09:21,860::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:09:21,861::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`92c6cf72-7723-445b-891c-156d87a059ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:09:21,861::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:09:21,861::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:09:21,861::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`92c6cf72-7723-445b-891c-156d87a059ee`::Granted request >Thread-32::DEBUG::2014-08-12 15:09:21,862::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0716d26b-2ed1-4be5-8379-be99bc2caf6f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:09:21,862::task::993::Storage.TaskManager.Task::(_decref) Task=`0716d26b-2ed1-4be5-8379-be99bc2caf6f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:09:21,874::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:21,875::task::1191::Storage.TaskManager.Task::(prepare) Task=`0716d26b-2ed1-4be5-8379-be99bc2caf6f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:21,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`0716d26b-2ed1-4be5-8379-be99bc2caf6f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:09:21,875::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:09:21,875::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:09:21,876::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:09:21,876::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:09:21,876::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:09:21,876::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:09:21,876::task::993::Storage.TaskManager.Task::(_decref) Task=`0716d26b-2ed1-4be5-8379-be99bc2caf6f`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:09:22,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:22,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131972 s, 77.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:09:23,861::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:09:24,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:24,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129797 s, 78.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:09:25,084::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:25,096::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695098 s, 5.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:09:25,099::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:09:25,099::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:09:25,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:25,099::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:25,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:25,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:25,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:25,100::__init__::225::IOProcess::(_processLogs) (14360) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:25,100::__init__::225::IOProcess::(_processLogs) (14360) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:25,100::__init__::225::IOProcess::(_processLogs) (14360) Building response >Thread-25::DEBUG::2014-08-12 15:09:25,101::__init__::225::IOProcess::(_processLogs) (14360) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:25,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:25,101::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:09:25,102::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:09:25,102::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:09:25,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:25,102::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:25,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:25,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:25,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:25,103::__init__::225::IOProcess::(_processLogs) (14361) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:25,103::__init__::225::IOProcess::(_processLogs) (14361) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:25,103::__init__::225::IOProcess::(_processLogs) (14361) Building response >Thread-25::DEBUG::2014-08-12 15:09:25,103::__init__::225::IOProcess::(_processLogs) (14361) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:25,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:25,104::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:09:25,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:09:25,742::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064045 s, 6.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:09:25,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6de3257-5a1b-4b09-bf18-e08dd4142436`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:25,895::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:09:25,895::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695098', 'lastCheck': '0.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064045', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:09:25,895::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6de3257-5a1b-4b09-bf18-e08dd4142436`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695098', 'lastCheck': '0.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064045', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:09:25,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6de3257-5a1b-4b09-bf18-e08dd4142436`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:25,895::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:25,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:25,896::task::993::Storage.TaskManager.Task::(_decref) Task=`b6de3257-5a1b-4b09-bf18-e08dd4142436`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:09:25,919::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:26,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:26,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013286 s, 77.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:26,824::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:26,825::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:26,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:28,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:28,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130165 s, 78.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:30,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:30,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139193 s, 73.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:31,846::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:31,847::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:31,856::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:09:31,894::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:09:31,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`54b2b461-86a5-444d-9b67-1bde7c373ab8`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:31,894::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:09:31,907::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:31,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`54b2b461-86a5-444d-9b67-1bde7c373ab8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:31,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`54b2b461-86a5-444d-9b67-1bde7c373ab8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:31,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:31,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:31,908::task::993::Storage.TaskManager.Task::(_decref) Task=`54b2b461-86a5-444d-9b67-1bde7c373ab8`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:09:31,929::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:09:31,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6b20a54-96f2-4090-bed3-8e25a0dc65fa`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:09:31,929::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:09:31,931::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a9829df3-590a-4bac-91fb-7338fc0b0630`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:09:31,932::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:09:31,932::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:09:31,932::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a9829df3-590a-4bac-91fb-7338fc0b0630`::Granted request >Thread-32::DEBUG::2014-08-12 15:09:31,932::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c6b20a54-96f2-4090-bed3-8e25a0dc65fa`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:09:31,933::task::993::Storage.TaskManager.Task::(_decref) Task=`c6b20a54-96f2-4090-bed3-8e25a0dc65fa`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:09:31,945::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:31,945::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6b20a54-96f2-4090-bed3-8e25a0dc65fa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:31,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6b20a54-96f2-4090-bed3-8e25a0dc65fa`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:09:31,946::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:09:31,946::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:09:31,946::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:09:31,946::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:09:31,946::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:09:31,947::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:09:31,947::task::993::Storage.TaskManager.Task::(_decref) Task=`c6b20a54-96f2-4090-bed3-8e25a0dc65fa`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:09:32,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:32,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130629 s, 78.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:34,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:34,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131409 s, 77.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:09:35,105::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::DEBUG::2014-08-12 15:09:35,105::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:09:35,105::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:35,117::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000636984 s, 3.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:09:35,118::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000636984 s, 3.2 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:09:35,118::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:09:35,118::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:09:35,118::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:09:35,119::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:09:35,119::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:09:35,119::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:09:35,119::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:09:35,120::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:09:35,120::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:35,419::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:09:35,419::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:09:35,419::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::INFO::2014-08-12 15:09:35,420::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::INFO::2014-08-12 15:09:35,421::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::INFO::2014-08-12 15:09:35,421::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:09:35,421::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:35,593::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:09:35,593::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:35,605::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061848 s, 6.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:09:35,608::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:09:35,609::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:09:35,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:35,609::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:35,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:35,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:35,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:35,610::__init__::225::IOProcess::(_processLogs) (14362) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:35,610::__init__::225::IOProcess::(_processLogs) (14362) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:35,610::__init__::225::IOProcess::(_processLogs) (14362) Building response >Thread-25::DEBUG::2014-08-12 15:09:35,610::__init__::225::IOProcess::(_processLogs) (14362) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:35,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:35,610::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:09:35,611::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:09:35,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:35,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:35,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:35,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:35,612::__init__::225::IOProcess::(_processLogs) (14363) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:35,612::__init__::225::IOProcess::(_processLogs) (14363) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:35,612::__init__::225::IOProcess::(_processLogs) (14363) Building response >Thread-25::DEBUG::2014-08-12 15:09:35,612::__init__::225::IOProcess::(_processLogs) (14363) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:35,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:35,613::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:09:35,744::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:09:35,754::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708652 s, 5.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:36,863::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:36,864::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:36,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:36,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:37,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130602 s, 78.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:39,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:39,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131084 s, 78.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:09:41,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c32e800-0cfb-4eac-8a0a-d13138bd780e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:41,061::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:09:41,061::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061848', 'lastCheck': '5.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708652', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:09:41,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c32e800-0cfb-4eac-8a0a-d13138bd780e`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061848', 'lastCheck': '5.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708652', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:09:41,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c32e800-0cfb-4eac-8a0a-d13138bd780e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:41,061::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:41,062::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:41,062::task::993::Storage.TaskManager.Task::(_decref) Task=`7c32e800-0cfb-4eac-8a0a-d13138bd780e`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:09:41,084::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:41,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:41,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130644 s, 78.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:41,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:41,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:41,904::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:09:41,963::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:09:41,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8173dd8-d258-4c92-9185-1f1fbe31a4e2`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:41,964::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:09:41,976::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:41,976::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8173dd8-d258-4c92-9185-1f1fbe31a4e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:41,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8173dd8-d258-4c92-9185-1f1fbe31a4e2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:41,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:41,977::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:41,977::task::993::Storage.TaskManager.Task::(_decref) Task=`d8173dd8-d258-4c92-9185-1f1fbe31a4e2`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:09:41,990::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:09:41,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`f642ebc4-90d0-4334-bf9d-716578442c7f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:09:41,991::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:09:41,991::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`1d7cd8d5-5225-4f51-94ae-70b32291ef41`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:09:41,991::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:09:41,992::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:09:41,992::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`1d7cd8d5-5225-4f51-94ae-70b32291ef41`::Granted request >Thread-32::DEBUG::2014-08-12 15:09:41,992::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f642ebc4-90d0-4334-bf9d-716578442c7f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:09:41,992::task::993::Storage.TaskManager.Task::(_decref) Task=`f642ebc4-90d0-4334-bf9d-716578442c7f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:09:42,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:42,005::task::1191::Storage.TaskManager.Task::(prepare) Task=`f642ebc4-90d0-4334-bf9d-716578442c7f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:42,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`f642ebc4-90d0-4334-bf9d-716578442c7f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:09:42,005::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:09:42,005::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:09:42,006::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:09:42,006::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:09:42,006::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:09:42,006::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:09:42,006::task::993::Storage.TaskManager.Task::(_decref) Task=`f642ebc4-90d0-4334-bf9d-716578442c7f`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:09:43,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:43,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276029 s, 37.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:45,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:45,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0162407 s, 63.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:09:45,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:45,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00794396 s, 516 kB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:09:45,637::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:09:45,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:45,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:45,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:45,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:45,638::__init__::225::IOProcess::(_processLogs) (14364) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:45,638::__init__::225::IOProcess::(_processLogs) (14364) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:45,638::__init__::225::IOProcess::(_processLogs) (14364) Building response >Thread-25::DEBUG::2014-08-12 15:09:45,638::__init__::225::IOProcess::(_processLogs) (14364) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:45,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:45,639::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:09:45,640::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:09:45,640::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:45,640::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:45,640::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:45,640::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:45,641::__init__::225::IOProcess::(_processLogs) (14365) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:45,641::__init__::225::IOProcess::(_processLogs) (14365) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:45,641::__init__::225::IOProcess::(_processLogs) (14365) Building response >Thread-25::DEBUG::2014-08-12 15:09:45,641::__init__::225::IOProcess::(_processLogs) (14365) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:45,641::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:09:45,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:09:45,768::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713638 s, 5.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:46,910::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:46,911::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:46,915::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:47,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:47,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134797 s, 76.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:49,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:49,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146521 s, 69.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:51,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:51,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131541 s, 77.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:51,922::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:51,923::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:51,933::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:09:52,022::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:09:52,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f7b9fac-4964-4661-b310-3c2d18c0dac5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:52,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:09:52,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:52,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f7b9fac-4964-4661-b310-3c2d18c0dac5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:09:52,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f7b9fac-4964-4661-b310-3c2d18c0dac5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:52,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:52,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:52,036::task::993::Storage.TaskManager.Task::(_decref) Task=`6f7b9fac-4964-4661-b310-3c2d18c0dac5`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:09:52,049::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:09:52,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`5839cf31-f92b-493c-8369-05f8d066b893`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:09:52,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:09:52,050::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`767993d3-304a-4f7f-b22a-04c4a4954e3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:09:52,050::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:09:52,051::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:09:52,051::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`767993d3-304a-4f7f-b22a-04c4a4954e3c`::Granted request >Thread-32::DEBUG::2014-08-12 15:09:52,051::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5839cf31-f92b-493c-8369-05f8d066b893`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:09:52,051::task::993::Storage.TaskManager.Task::(_decref) Task=`5839cf31-f92b-493c-8369-05f8d066b893`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:09:52,063::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:52,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`5839cf31-f92b-493c-8369-05f8d066b893`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:09:52,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`5839cf31-f92b-493c-8369-05f8d066b893`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:09:52,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:09:52,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:09:52,064::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:09:52,065::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:09:52,065::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:09:52,065::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:09:52,065::task::993::Storage.TaskManager.Task::(_decref) Task=`5839cf31-f92b-493c-8369-05f8d066b893`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:09:53,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:53,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0551933 s, 18.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:09:53,929::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-16::DEBUG::2014-08-12 15:09:55,643::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:09:55,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000743434 s, 5.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:09:55,658::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:09:55,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:55,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:55,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:55,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:55,658::__init__::225::IOProcess::(_processLogs) (14366) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:55,659::__init__::225::IOProcess::(_processLogs) (14366) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:55,659::__init__::225::IOProcess::(_processLogs) (14366) Building response >Thread-25::DEBUG::2014-08-12 15:09:55,659::__init__::225::IOProcess::(_processLogs) (14366) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:55,659::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:09:55,660::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:09:55,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:09:55,660::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:09:55,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:09:55,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:09:55,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:09:55,661::__init__::225::IOProcess::(_processLogs) (14367) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:09:55,661::__init__::225::IOProcess::(_processLogs) (14367) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:09:55,661::__init__::225::IOProcess::(_processLogs) (14367) Building response >Thread-25::DEBUG::2014-08-12 15:09:55,661::__init__::225::IOProcess::(_processLogs) (14367) Queuing response >Thread-25::DEBUG::2014-08-12 15:09:55,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:09:55,662::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:09:55,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:55,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131606 s, 77.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:09:55,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:09:55,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622328 s, 6.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:09:56,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`5775170d-685c-4087-810a-f5ead48d76de`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:09:56,180::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:09:56,181::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743434', 'lastCheck': '0.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622328', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:09:56,181::task::1191::Storage.TaskManager.Task::(prepare) Task=`5775170d-685c-4087-810a-f5ead48d76de`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743434', 'lastCheck': '0.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622328', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:09:56,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`5775170d-685c-4087-810a-f5ead48d76de`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:09:56,181::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:09:56,181::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:09:56,182::task::993::Storage.TaskManager.Task::(_decref) Task=`5775170d-685c-4087-810a-f5ead48d76de`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:09:56,206::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-44::DEBUG::2014-08-12 15:09:56,409::task::595::Storage.TaskManager.Task::(_updateState) Task=`363a83a2-03dd-4fb1-8dfa-3260d5fc72da`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:09:56,409::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:09:56,410::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:09:56,410::task::1191::Storage.TaskManager.Task::(prepare) Task=`363a83a2-03dd-4fb1-8dfa-3260d5fc72da`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:09:56,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`363a83a2-03dd-4fb1-8dfa-3260d5fc72da`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:09:56,410::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:09:56,410::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:09:56,411::task::993::Storage.TaskManager.Task::(_decref) Task=`363a83a2-03dd-4fb1-8dfa-3260d5fc72da`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:09:56,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`29389235-123b-428e-b8c4-6a29deaa9786`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:09:56,411::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:09:56,411::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:09:56,411::task::1191::Storage.TaskManager.Task::(prepare) Task=`29389235-123b-428e-b8c4-6a29deaa9786`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:09:56,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`29389235-123b-428e-b8c4-6a29deaa9786`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:09:56,412::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:09:56,412::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:09:56,412::task::993::Storage.TaskManager.Task::(_decref) Task=`29389235-123b-428e-b8c4-6a29deaa9786`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:09:56,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`86dc57a0-6e71-4ce8-a6c7-d9dfc12a0f86`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:09:56,413::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:09:56,413::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:09:56,413::task::1191::Storage.TaskManager.Task::(prepare) Task=`86dc57a0-6e71-4ce8-a6c7-d9dfc12a0f86`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:09:56,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`86dc57a0-6e71-4ce8-a6c7-d9dfc12a0f86`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:09:56,413::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:09:56,413::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:09:56,414::task::993::Storage.TaskManager.Task::(_decref) Task=`86dc57a0-6e71-4ce8-a6c7-d9dfc12a0f86`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:09:56,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`00e51ffc-4441-4cd4-9e2a-d0545c045e87`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:09:56,414::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:09:56,414::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:09:56,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`00e51ffc-4441-4cd4-9e2a-d0545c045e87`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:09:56,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`00e51ffc-4441-4cd4-9e2a-d0545c045e87`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:09:56,415::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:09:56,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:09:56,415::task::993::Storage.TaskManager.Task::(_decref) Task=`00e51ffc-4441-4cd4-9e2a-d0545c045e87`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:56,939::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:56,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:09:56,956::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:09:57,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:57,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133596 s, 76.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:09:59,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:09:59,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131878 s, 77.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:01,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:01,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:01,971::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:01,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:10:02,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128041 s, 80.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:10:02,082::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:10:02,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`1159781e-8dfb-4f5b-a5c8-c10edbb68ef0`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:02,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:10:02,095::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:02,095::task::1191::Storage.TaskManager.Task::(prepare) Task=`1159781e-8dfb-4f5b-a5c8-c10edbb68ef0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:02,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`1159781e-8dfb-4f5b-a5c8-c10edbb68ef0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:02,095::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:02,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:02,096::task::993::Storage.TaskManager.Task::(_decref) Task=`1159781e-8dfb-4f5b-a5c8-c10edbb68ef0`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:10:02,109::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:10:02,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac450220-4481-4f23-88ed-7f413bf249dc`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:10:02,110::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:10:02,110::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8a60f57a-6535-4041-a8a5-a588b4a35ae0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:10:02,110::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:10:02,111::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:10:02,111::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8a60f57a-6535-4041-a8a5-a588b4a35ae0`::Granted request >Thread-32::DEBUG::2014-08-12 15:10:02,111::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac450220-4481-4f23-88ed-7f413bf249dc`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:10:02,112::task::993::Storage.TaskManager.Task::(_decref) Task=`ac450220-4481-4f23-88ed-7f413bf249dc`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:10:02,124::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:02,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac450220-4481-4f23-88ed-7f413bf249dc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:02,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac450220-4481-4f23-88ed-7f413bf249dc`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:10:02,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:10:02,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:10:02,125::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:10:02,125::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:10:02,125::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:10:02,125::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:10:02,126::task::993::Storage.TaskManager.Task::(_decref) Task=`ac450220-4481-4f23-88ed-7f413bf249dc`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:10:04,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:04,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133288 s, 76.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:10:05,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:10:05,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760525 s, 5.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:10:05,678::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:05,678::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:10:05,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:05,679::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:05,679::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:05,679::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:05,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:05,679::__init__::225::IOProcess::(_processLogs) (14368) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:05,679::__init__::225::IOProcess::(_processLogs) (14368) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:05,680::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(14368) Building response >Thread-25::DEBUG::2014-08-12 15:10:05,680::__init__::225::IOProcess::(_processLogs) (14368) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:05,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:05,680::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:10:05,681::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:05,681::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:10:05,681::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:05,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:05,682::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:05,682::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:05,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:05,682::__init__::225::IOProcess::(_processLogs) (14369) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:05,682::__init__::225::IOProcess::(_processLogs) (14369) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:05,682::__init__::225::IOProcess::(_processLogs) (14369) Building response >Thread-25::DEBUG::2014-08-12 15:10:05,683::__init__::225::IOProcess::(_processLogs) (14369) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:05,683::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:05,683::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:10:05,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:05,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595604 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:06,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:06,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133252 s, 76.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:06,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:06,979::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:06,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:10:08,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:08,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256357 s, 39.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:10,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:10,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132366 s, 77.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:10:11,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`5236eada-8aa0-4f08-9a07-ed9e5d8ac71a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:11,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:10:11,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760525', 'lastCheck': '5.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595604', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:10:11,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`5236eada-8aa0-4f08-9a07-ed9e5d8ac71a`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760525', 'lastCheck': '5.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595604', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:10:11,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`5236eada-8aa0-4f08-9a07-ed9e5d8ac71a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:11,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:11,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:11,315::task::993::Storage.TaskManager.Task::(_decref) Task=`5236eada-8aa0-4f08-9a07-ed9e5d8ac71a`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:10:11,345::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:12,004::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:12,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:12,015::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:10:12,140::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:10:12,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`51366088-602d-4e97-ab99-27bd3d491f90`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:12,141::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:10:12,153::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:12,153::task::1191::Storage.TaskManager.Task::(prepare) Task=`51366088-602d-4e97-ab99-27bd3d491f90`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:12,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`51366088-602d-4e97-ab99-27bd3d491f90`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:12,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:12,154::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:12,154::task::993::Storage.TaskManager.Task::(_decref) Task=`51366088-602d-4e97-ab99-27bd3d491f90`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:10:12,165::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:10:12,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`881cf04f-1759-4007-aa38-c9fbd2bcff54`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:10:12,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:10:12,166::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`b67768f1-495e-423d-b450-b66d5964331b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:10:12,167::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:10:12,167::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:10:12,167::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`b67768f1-495e-423d-b450-b66d5964331b`::Granted request >Thread-32::DEBUG::2014-08-12 15:10:12,167::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`881cf04f-1759-4007-aa38-c9fbd2bcff54`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:10:12,168::task::993::Storage.TaskManager.Task::(_decref) Task=`881cf04f-1759-4007-aa38-c9fbd2bcff54`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:10:12,180::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:12,180::task::1191::Storage.TaskManager.Task::(prepare) Task=`881cf04f-1759-4007-aa38-c9fbd2bcff54`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:12,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`881cf04f-1759-4007-aa38-c9fbd2bcff54`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:10:12,180::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:10:12,181::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:10:12,181::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:10:12,181::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:10:12,181::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:10:12,181::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:10:12,182::task::993::Storage.TaskManager.Task::(_decref) Task=`881cf04f-1759-4007-aa38-c9fbd2bcff54`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:10:12,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:12,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130894 s, 78.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:14,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:14,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133575 s, 76.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:10:15,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:10:15,698::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0031515 s, 1.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:10:15,701::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:15,701::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:10:15,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:15,702::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:15,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:15,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:15,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:15,702::__init__::225::IOProcess::(_processLogs) (14370) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:15,703::__init__::225::IOProcess::(_processLogs) (14370) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:15,703::__init__::225::IOProcess::(_processLogs) (14370) Building response >Thread-25::DEBUG::2014-08-12 15:10:15,703::__init__::225::IOProcess::(_processLogs) (14370) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:15,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:15,703::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:10:15,704::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:15,704::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:10:15,704::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:15,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:15,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:15,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:15,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:15,705::__init__::225::IOProcess::(_processLogs) (14371) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:15,705::__init__::225::IOProcess::(_processLogs) (14371) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:15,706::__init__::225::IOProcess::(_processLogs) (14371) Building response >Thread-25::DEBUG::2014-08-12 15:10:15,706::__init__::225::IOProcess::(_processLogs) (14371) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:15,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:15,706::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:10:15,812::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:15,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596085 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:16,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:16,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193261 s, 53.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:17,022::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:17,023::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:17,027::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:10:18,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:18,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013052 s, 78.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:20,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:20,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129533 s, 79.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:22,033::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:22,034::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:22,044::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:10:22,197::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:10:22,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`608f9bb4-78ad-46d5-8ca0-07c9e376d414`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:22,198::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:10:22,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:22,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`608f9bb4-78ad-46d5-8ca0-07c9e376d414`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:22,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`608f9bb4-78ad-46d5-8ca0-07c9e376d414`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:22,229::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:22,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:22,229::task::993::Storage.TaskManager.Task::(_decref) Task=`608f9bb4-78ad-46d5-8ca0-07c9e376d414`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:10:22,240::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:10:22,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef20803a-d19a-4f38-b094-1f169336ef93`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:10:22,241::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:10:22,241::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`99bfdb16-400a-4ebc-bcb4-f6136d76807c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:10:22,242::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:10:22,242::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:10:22,242::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`99bfdb16-400a-4ebc-bcb4-f6136d76807c`::Granted request >Thread-32::DEBUG::2014-08-12 15:10:22,242::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ef20803a-d19a-4f38-b094-1f169336ef93`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:10:22,243::task::993::Storage.TaskManager.Task::(_decref) Task=`ef20803a-d19a-4f38-b094-1f169336ef93`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:10:22,255::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:22,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef20803a-d19a-4f38-b094-1f169336ef93`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:22,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef20803a-d19a-4f38-b094-1f169336ef93`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:10:22,255::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:10:22,255::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:10:22,256::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:10:22,256::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:10:22,256::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:10:22,256::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:10:22,256::task::993::Storage.TaskManager.Task::(_decref) Task=`ef20803a-d19a-4f38-b094-1f169336ef93`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:10:22,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:23,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133096 s, 76.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:10:23,987::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:10:25,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:25,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131272 s, 78.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:10:25,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:10:25,719::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686625 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:10:25,722::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:25,722::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:10:25,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:25,722::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:25,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:25,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:25,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:25,723::__init__::225::IOProcess::(_processLogs) (14372) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:25,723::__init__::225::IOProcess::(_processLogs) (14372) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:25,723::__init__::225::IOProcess::(_processLogs) (14372) Building response >Thread-25::DEBUG::2014-08-12 15:10:25,724::__init__::225::IOProcess::(_processLogs) (14372) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:25,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:25,724::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:10:25,725::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:25,725::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:10:25,725::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:25,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:25,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:25,726::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:25,726::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:25,726::__init__::225::IOProcess::(_processLogs) (14373) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:25,726::__init__::225::IOProcess::(_processLogs) (14373) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:25,726::__init__::225::IOProcess::(_processLogs) (14373) Building response >Thread-25::DEBUG::2014-08-12 15:10:25,726::__init__::225::IOProcess::(_processLogs) (14373) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:25,726::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:25,727::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:10:25,825::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-33::DEBUG::2014-08-12 15:10:25,825::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:10:25,826::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:25,839::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000545374 s, 3.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:10:25,840::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000545374 s, 3.8 MB/s'], size: 2048 >Thread-33::DEBUG::2014-08-12 15:10:25,840::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-33::DEBUG::2014-08-12 15:10:25,840::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-33::DEBUG::2014-08-12 15:10:25,840::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:10:25,840::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:10:25,841::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:10:25,841::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:10:25,841::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:10:25,841::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:10:25,842::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:26,117::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:10:26,119::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:10:26,119::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-33::INFO::2014-08-12 15:10:26,120::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-33::INFO::2014-08-12 15:10:26,120::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-33::INFO::2014-08-12 15:10:26,120::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-33::DEBUG::2014-08-12 15:10:26,121::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:26,291::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:10:26,291::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:26,304::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813962 s, 5.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:10:26,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`476bacaa-bd93-4e6c-b0f6-699ff8dfccce`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:26,476::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:10:26,476::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686625', 'lastCheck': '0.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813962', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:10:26,477::task::1191::Storage.TaskManager.Task::(prepare) Task=`476bacaa-bd93-4e6c-b0f6-699ff8dfccce`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686625', 'lastCheck': '0.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813962', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:10:26,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`476bacaa-bd93-4e6c-b0f6-699ff8dfccce`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:26,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:26,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:26,477::task::993::Storage.TaskManager.Task::(_decref) Task=`476bacaa-bd93-4e6c-b0f6-699ff8dfccce`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:10:26,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:27,050::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:27,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:27,068::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:10:27,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:27,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136485 s, 75.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:29,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:29,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132108 s, 77.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:31,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:31,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0210279 s, 48.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:32,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:32,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:32,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:10:32,273::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:10:32,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`b499ea14-b8ab-4405-8926-4b157dc18d52`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:32,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:10:32,303::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:32,308::task::1191::Storage.TaskManager.Task::(prepare) Task=`b499ea14-b8ab-4405-8926-4b157dc18d52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:32,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`b499ea14-b8ab-4405-8926-4b157dc18d52`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:32,309::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:32,309::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:32,309::task::993::Storage.TaskManager.Task::(_decref) Task=`b499ea14-b8ab-4405-8926-4b157dc18d52`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:10:32,321::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:10:32,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`20ec9fbf-0e28-4dce-a516-ab2afd2e7816`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:10:32,322::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:10:32,322::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2a88a41c-752f-44ae-9e49-608fadc8d796`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:10:32,322::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:10:32,322::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:10:32,323::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2a88a41c-752f-44ae-9e49-608fadc8d796`::Granted request >Thread-32::DEBUG::2014-08-12 15:10:32,323::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`20ec9fbf-0e28-4dce-a516-ab2afd2e7816`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:10:32,323::task::993::Storage.TaskManager.Task::(_decref) Task=`20ec9fbf-0e28-4dce-a516-ab2afd2e7816`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:10:32,335::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:32,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`20ec9fbf-0e28-4dce-a516-ab2afd2e7816`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:32,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`20ec9fbf-0e28-4dce-a516-ab2afd2e7816`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:10:32,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:10:32,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:10:32,336::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:10:32,337::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:10:32,337::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:10:32,337::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:10:32,337::task::993::Storage.TaskManager.Task::(_decref) Task=`20ec9fbf-0e28-4dce-a516-ab2afd2e7816`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:10:33,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:33,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172558 s, 59.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:35,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:35,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0160779 s, 63.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:10:35,728::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:10:35,740::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609484 s, 6.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:10:35,744::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:35,744::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:10:35,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:35,744::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:35,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:35,745::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:35,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:35,745::__init__::225::IOProcess::(_processLogs) (14374) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:35,745::__init__::225::IOProcess::(_processLogs) (14374) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:35,745::__init__::225::IOProcess::(_processLogs) (14374) Building response >Thread-25::DEBUG::2014-08-12 15:10:35,746::__init__::225::IOProcess::(_processLogs) (14374) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:35,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:35,746::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:10:35,747::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:35,747::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:10:35,747::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:35,747::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:35,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:35,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:35,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:35,748::__init__::225::IOProcess::(_processLogs) (14375) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:35,748::__init__::225::IOProcess::(_processLogs) (14375) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:35,748::__init__::225::IOProcess::(_processLogs) (14375) Building response >Thread-25::DEBUG::2014-08-12 15:10:35,748::__init__::225::IOProcess::(_processLogs) (14375) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:35,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:35,749::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:10:36,307::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:36,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564642 s, 7.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:37,083::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:37,084::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:37,103::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:10:37,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:37,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0210811 s, 48.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:39,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:39,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123195 s, 83.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:10:41,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`da7e9d1f-cb81-48d9-851a-10bbd60c92f4`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:41,610::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:10:41,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609484', 'lastCheck': '5.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564642', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:10:41,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`da7e9d1f-cb81-48d9-851a-10bbd60c92f4`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609484', 'lastCheck': '5.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564642', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:10:41,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`da7e9d1f-cb81-48d9-851a-10bbd60c92f4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:41,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:41,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:41,612::task::993::Storage.TaskManager.Task::(_decref) Task=`da7e9d1f-cb81-48d9-851a-10bbd60c92f4`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:10:41,632::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:10:41,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:41,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121981 s, 83.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:42,109::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:42,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:42,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:10:42,354::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [286df953] >Thread-14::DEBUG::2014-08-12 15:10:42,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d35826a-f6ce-46c8-ba4a-58006fbf8988`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:42,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:10:42,367::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:42,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d35826a-f6ce-46c8-ba4a-58006fbf8988`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:42,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d35826a-f6ce-46c8-ba4a-58006fbf8988`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:42,367::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:42,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:42,368::task::993::Storage.TaskManager.Task::(_decref) Task=`3d35826a-f6ce-46c8-ba4a-58006fbf8988`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:10:42,380::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [286df953] >Thread-32::DEBUG::2014-08-12 15:10:42,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`7edd9d9a-b688-42ee-a275-6462a87e3494`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:10:42,380::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:10:42,381::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8e1dd5b6-083f-4384-a12f-d9488d259f76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:10:42,381::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:10:42,381::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:10:42,382::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8e1dd5b6-083f-4384-a12f-d9488d259f76`::Granted request >Thread-32::DEBUG::2014-08-12 15:10:42,382::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7edd9d9a-b688-42ee-a275-6462a87e3494`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:10:42,382::task::993::Storage.TaskManager.Task::(_decref) Task=`7edd9d9a-b688-42ee-a275-6462a87e3494`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:10:42,394::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:42,395::task::1191::Storage.TaskManager.Task::(prepare) Task=`7edd9d9a-b688-42ee-a275-6462a87e3494`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:42,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`7edd9d9a-b688-42ee-a275-6462a87e3494`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:10:42,395::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:10:42,395::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:10:42,395::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:10:42,396::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:10:42,396::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:10:42,396::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:10:42,396::task::993::Storage.TaskManager.Task::(_decref) Task=`7edd9d9a-b688-42ee-a275-6462a87e3494`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:10:43,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:43,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122188 s, 83.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:10:45,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:10:45,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000573478 s, 7.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:10:45,766::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:45,766::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:10:45,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:45,766::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:45,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:45,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:45,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:45,767::__init__::225::IOProcess::(_processLogs) (14376) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:45,767::__init__::225::IOProcess::(_processLogs) (14376) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:45,767::__init__::225::IOProcess::(_processLogs) (14376) Building response >Thread-25::DEBUG::2014-08-12 15:10:45,767::__init__::225::IOProcess::(_processLogs) (14376) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:45,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:45,768::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:10:45,769::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:45,769::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:10:45,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:45,769::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:45,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:45,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:45,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:45,770::__init__::225::IOProcess::(_processLogs) (14377) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:45,770::__init__::225::IOProcess::(_processLogs) (14377) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:45,770::__init__::225::IOProcess::(_processLogs) (14377) Building response >Thread-25::DEBUG::2014-08-12 15:10:45,770::__init__::225::IOProcess::(_processLogs) (14377) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:45,771::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:45,771::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:10:45,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:45,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119776 s, 85.5 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:10:46,319::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:46,332::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069951 s, 5.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:47,118::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:47,118::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:47,133::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:10:47,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:48,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120099 s, 85.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:50,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:50,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121917 s, 84.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:10:52,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:52,139::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:52,142::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:52,145::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:10:52,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186828 s, 54.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:10:52,412::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [7eef42eb] >Thread-14::DEBUG::2014-08-12 15:10:52,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`0deeb728-3385-4ee7-91f2-42f77a8b336f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:52,413::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:10:52,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:52,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`0deeb728-3385-4ee7-91f2-42f77a8b336f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:10:52,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`0deeb728-3385-4ee7-91f2-42f77a8b336f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:52,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:52,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:52,448::task::993::Storage.TaskManager.Task::(_decref) Task=`0deeb728-3385-4ee7-91f2-42f77a8b336f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:10:52,460::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [7eef42eb] >Thread-32::DEBUG::2014-08-12 15:10:52,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`456fe3c6-45ae-4d20-b7ce-65da9bcb5db0`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:10:52,461::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:10:52,461::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ce3503df-c617-4c60-bae6-d960b1520e90`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:10:52,461::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:10:52,462::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:10:52,462::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ce3503df-c617-4c60-bae6-d960b1520e90`::Granted request >Thread-32::DEBUG::2014-08-12 15:10:52,462::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`456fe3c6-45ae-4d20-b7ce-65da9bcb5db0`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:10:52,462::task::993::Storage.TaskManager.Task::(_decref) Task=`456fe3c6-45ae-4d20-b7ce-65da9bcb5db0`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:10:52,475::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:52,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`456fe3c6-45ae-4d20-b7ce-65da9bcb5db0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:10:52,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`456fe3c6-45ae-4d20-b7ce-65da9bcb5db0`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:10:52,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:10:52,476::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:10:52,476::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:10:52,476::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:10:52,476::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:10:52,476::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:10:52,477::task::993::Storage.TaskManager.Task::(_decref) Task=`456fe3c6-45ae-4d20-b7ce-65da9bcb5db0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-12 15:10:54,041::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:10:54,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:54,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121123 s, 84.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:10:55,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:10:55,784::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696892 s, 5.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:10:55,787::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:55,787::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:10:55,787::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:55,788::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:55,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:55,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:55,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:55,788::__init__::225::IOProcess::(_processLogs) (14378) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:55,788::__init__::225::IOProcess::(_processLogs) (14378) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:55,789::__init__::225::IOProcess::(_processLogs) (14378) Building response >Thread-25::DEBUG::2014-08-12 15:10:55,789::__init__::225::IOProcess::(_processLogs) (14378) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:55,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:55,789::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:10:55,790::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:10:55,790::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:10:55,790::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:10:55,790::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:10:55,791::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:10:55,791::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:10:55,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:10:55,791::__init__::225::IOProcess::(_processLogs) (14379) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:10:55,791::__init__::225::IOProcess::(_processLogs) (14379) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:10:55,791::__init__::225::IOProcess::(_processLogs) (14379) Building response >Thread-25::DEBUG::2014-08-12 15:10:55,792::__init__::225::IOProcess::(_processLogs) (14379) Queuing response >Thread-25::DEBUG::2014-08-12 15:10:55,792::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:10:55,792::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:10:56,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:56,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119195 s, 85.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:10:56,336::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:10:56,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596491 s, 6.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:10:56,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb1435aa-b0d3-4906-8ddc-217875debc68`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:10:56,722::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:10:56,722::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696892', 'lastCheck': '0.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596491', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:10:56,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb1435aa-b0d3-4906-8ddc-217875debc68`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696892', 'lastCheck': '0.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596491', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:10:56,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb1435aa-b0d3-4906-8ddc-217875debc68`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:10:56,723::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:10:56,723::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:10:56,723::task::993::Storage.TaskManager.Task::(_decref) Task=`bb1435aa-b0d3-4906-8ddc-217875debc68`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:10:56,746::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:57,153::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:57,154::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:10:57,168::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-44::DEBUG::2014-08-12 15:10:57,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`c39d1c7f-c790-4b97-8a5a-198e52d223e0`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:10:57,305::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:10:57,306::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:10:57,306::task::1191::Storage.TaskManager.Task::(prepare) Task=`c39d1c7f-c790-4b97-8a5a-198e52d223e0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:10:57,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`c39d1c7f-c790-4b97-8a5a-198e52d223e0`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:10:57,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:10:57,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:10:57,306::task::993::Storage.TaskManager.Task::(_decref) Task=`c39d1c7f-c790-4b97-8a5a-198e52d223e0`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:10:57,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`49857c3f-0f9e-4683-830c-644a00d00df6`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:10:57,307::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:10:57,307::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:10:57,307::task::1191::Storage.TaskManager.Task::(prepare) Task=`49857c3f-0f9e-4683-830c-644a00d00df6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:10:57,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`49857c3f-0f9e-4683-830c-644a00d00df6`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:10:57,308::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:10:57,308::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:10:57,308::task::993::Storage.TaskManager.Task::(_decref) Task=`49857c3f-0f9e-4683-830c-644a00d00df6`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:10:57,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`574e4b64-9acc-49b6-8460-54ab706ab628`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:10:57,308::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:10:57,309::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:10:57,309::task::1191::Storage.TaskManager.Task::(prepare) Task=`574e4b64-9acc-49b6-8460-54ab706ab628`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:10:57,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`574e4b64-9acc-49b6-8460-54ab706ab628`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:10:57,309::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:10:57,309::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:10:57,309::task::993::Storage.TaskManager.Task::(_decref) Task=`574e4b64-9acc-49b6-8460-54ab706ab628`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:10:57,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`38aac299-d8b0-4681-895d-f1064196dca9`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:10:57,310::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:10:57,310::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:10:57,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`38aac299-d8b0-4681-895d-f1064196dca9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:10:57,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`38aac299-d8b0-4681-895d-f1064196dca9`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:10:57,311::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:10:57,311::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:10:57,311::task::993::Storage.TaskManager.Task::(_decref) Task=`38aac299-d8b0-4681-895d-f1064196dca9`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:10:58,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:10:58,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120734 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:00,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:00,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123416 s, 83.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:02,174::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:02,175::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:02,185::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:11:02,496::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [78ec6cc5] >Thread-14::DEBUG::2014-08-12 15:11:02,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0ebb914-c0dd-441c-aca6-5a475ec143bf`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:02,497::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Dummy-31::DEBUG::2014-08-12 15:11:02,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::INFO::2014-08-12 15:11:02,556::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Dummy-31::DEBUG::2014-08-12 15:11:02,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121012 s, 84.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:11:02,557::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0ebb914-c0dd-441c-aca6-5a475ec143bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:02,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0ebb914-c0dd-441c-aca6-5a475ec143bf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:02,559::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:02,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:02,559::task::993::Storage.TaskManager.Task::(_decref) Task=`f0ebb914-c0dd-441c-aca6-5a475ec143bf`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:11:02,574::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [78ec6cc5] >Thread-32::DEBUG::2014-08-12 15:11:02,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7ba0e79-3ae1-494b-981e-2bb6a00babfe`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:11:02,574::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:11:02,575::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`92f940d7-906d-4452-86d4-5b4e6ae4dd98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:11:02,575::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:11:02,576::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:11:02,576::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`92f940d7-906d-4452-86d4-5b4e6ae4dd98`::Granted request >Thread-32::DEBUG::2014-08-12 15:11:02,576::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a7ba0e79-3ae1-494b-981e-2bb6a00babfe`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:11:02,576::task::993::Storage.TaskManager.Task::(_decref) Task=`a7ba0e79-3ae1-494b-981e-2bb6a00babfe`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:11:02,589::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:02,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7ba0e79-3ae1-494b-981e-2bb6a00babfe`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:02,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7ba0e79-3ae1-494b-981e-2bb6a00babfe`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:11:02,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:11:02,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:11:02,590::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:11:02,590::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:11:02,590::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:11:02,590::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:11:02,591::task::993::Storage.TaskManager.Task::(_decref) Task=`a7ba0e79-3ae1-494b-981e-2bb6a00babfe`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:11:04,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:04,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122048 s, 83.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:11:05,793::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:11:05,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727959 s, 5.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:11:05,808::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:11:05,808::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:11:05,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:05,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:11:05,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:05,809::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:05,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:05,809::__init__::225::IOProcess::(_processLogs) (14380) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:05,809::__init__::225::IOProcess::(_processLogs) (14380) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:05,810::__init__::225::IOProcess::(_processLogs) (14380) Building response >Thread-25::DEBUG::2014-08-12 15:11:05,810::__init__::225::IOProcess::(_processLogs) (14380) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:05,810::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:05,810::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:11:05,811::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:11:05,811::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:11:05,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:05,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:05,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:05,812::__init__::225::IOProcess::(_processLogs) (14381) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:05,812::__init__::225::IOProcess::(_processLogs) (14381) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:05,812::__init__::225::IOProcess::(_processLogs) (14381) Building response >Thread-25::DEBUG::2014-08-12 15:11:05,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:05,812::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:11:06,352::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:11:06,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000761133 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:06,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:06,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120827 s, 84.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:07,192::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:07,193::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:07,209::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:11:08,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:08,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120045 s, 85.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:10,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:10,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125215 s, 81.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:11:11,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`099f88d9-2fc8-486e-b7c5-1f7ed71cd94f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:11,845::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:11:11,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727959', 'lastCheck': '6.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761133', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:11:11,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`099f88d9-2fc8-486e-b7c5-1f7ed71cd94f`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727959', 'lastCheck': '6.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761133', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:11:11,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`099f88d9-2fc8-486e-b7c5-1f7ed71cd94f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:11,846::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:11,846::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:11,847::task::993::Storage.TaskManager.Task::(_decref) Task=`099f88d9-2fc8-486e-b7c5-1f7ed71cd94f`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:11:11,870::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:12,211::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:12,212::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:12,220::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:11:12,609::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:11:12,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`08702a9d-325a-4681-8d70-8b38a97ad66a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:12,610::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:11:12,623::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:12,623::task::1191::Storage.TaskManager.Task::(prepare) Task=`08702a9d-325a-4681-8d70-8b38a97ad66a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:12,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`08702a9d-325a-4681-8d70-8b38a97ad66a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:12,623::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:12,624::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:12,624::task::993::Storage.TaskManager.Task::(_decref) Task=`08702a9d-325a-4681-8d70-8b38a97ad66a`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:11:12,637::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:11:12,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de83270-ba44-4fee-be2a-2340c784bc49`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:11:12,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:11:12,638::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`fdfb75cb-c24e-4a19-9c26-b0a92e7ba0bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:11:12,638::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:11:12,638::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:11:12,638::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`fdfb75cb-c24e-4a19-9c26-b0a92e7ba0bd`::Granted request >Thread-32::DEBUG::2014-08-12 15:11:12,639::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9de83270-ba44-4fee-be2a-2340c784bc49`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:11:12,639::task::993::Storage.TaskManager.Task::(_decref) Task=`9de83270-ba44-4fee-be2a-2340c784bc49`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:11:12,651::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:12,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`9de83270-ba44-4fee-be2a-2340c784bc49`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:12,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de83270-ba44-4fee-be2a-2340c784bc49`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:11:12,652::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:11:12,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:11:12,652::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:11:12,652::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:11:12,653::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:11:12,653::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:11:12,653::task::993::Storage.TaskManager.Task::(_decref) Task=`9de83270-ba44-4fee-be2a-2340c784bc49`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:11:12,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:12,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120986 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:14,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:14,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122003 s, 83.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:11:15,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:11:15,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000559135 s, 7.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:11:15,829::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:11:15,829::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:15,829::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:11:15,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:15,830::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:15,830::__init__::225::IOProcess::(_processLogs) (14382) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:15,830::__init__::225::IOProcess::(_processLogs) (14382) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:15,830::__init__::225::IOProcess::(_processLogs) (14382) Building response >Thread-25::DEBUG::2014-08-12 15:11:15,830::__init__::225::IOProcess::(_processLogs) (14382) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:15,831::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:15,831::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:11:15,832::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:11:15,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:15,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:15,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:15,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:15,832::__init__::225::IOProcess::(_processLogs) (14383) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:15,833::__init__::225::IOProcess::(_processLogs) (14383) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:15,833::__init__::225::IOProcess::(_processLogs) (14383) Building response >Thread-25::DEBUG::2014-08-12 15:11:15,833::__init__::225::IOProcess::(_processLogs) (14383) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:15,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:15,833::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:11:16,366::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:11:16,378::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595937 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:17,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:17,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121369 s, 84.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:17,227::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:17,228::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:17,238::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:11:19,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:19,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120691 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:21,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:21,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285392 s, 35.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:22,244::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:22,245::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:22,255::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:11:22,668::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [515eee7c] >Thread-14::DEBUG::2014-08-12 15:11:22,668::task::595::Storage.TaskManager.Task::(_updateState) Task=`d596e36b-597d-4594-a172-02405c9d5298`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:22,668::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:11:22,681::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:22,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`d596e36b-597d-4594-a172-02405c9d5298`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:22,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`d596e36b-597d-4594-a172-02405c9d5298`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:22,681::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:22,682::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:22,682::task::993::Storage.TaskManager.Task::(_decref) Task=`d596e36b-597d-4594-a172-02405c9d5298`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:11:22,694::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [515eee7c] >Thread-32::DEBUG::2014-08-12 15:11:22,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5a03fad-cfa1-4a4b-851c-fc63305080ee`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:11:22,695::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:11:22,695::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`23edcf3d-b111-44c7-8888-30ca3bcef33c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:11:22,696::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:11:22,696::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:11:22,696::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`23edcf3d-b111-44c7-8888-30ca3bcef33c`::Granted request >Thread-32::DEBUG::2014-08-12 15:11:22,696::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a5a03fad-cfa1-4a4b-851c-fc63305080ee`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:11:22,697::task::993::Storage.TaskManager.Task::(_decref) Task=`a5a03fad-cfa1-4a4b-851c-fc63305080ee`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:11:22,709::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:22,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5a03fad-cfa1-4a4b-851c-fc63305080ee`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:22,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5a03fad-cfa1-4a4b-851c-fc63305080ee`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:11:22,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:11:22,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:11:22,710::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:11:22,710::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:11:22,710::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:11:22,710::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:11:22,711::task::993::Storage.TaskManager.Task::(_decref) Task=`a5a03fad-cfa1-4a4b-851c-fc63305080ee`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:11:23,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:23,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121761 s, 84.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:11:24,076::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:11:25,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:25,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120398 s, 85.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:11:25,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:11:25,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079874 s, 5.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:11:25,851::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:11:25,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:25,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:25,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:25,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:25,852::__init__::225::IOProcess::(_processLogs) (14384) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:25,852::__init__::225::IOProcess::(_processLogs) (14384) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:25,852::__init__::225::IOProcess::(_processLogs) (14384) Building response >Thread-25::DEBUG::2014-08-12 15:11:25,852::__init__::225::IOProcess::(_processLogs) (14384) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:25,853::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:25,853::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:11:25,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:11:25,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:25,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:25,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:25,854::__init__::225::IOProcess::(_processLogs) (14385) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:25,854::__init__::225::IOProcess::(_processLogs) (14385) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:25,855::__init__::225::IOProcess::(_processLogs) (14385) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:25,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:25,855::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:11:26,382::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:11:26,393::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717981 s, 5.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:11:26,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`bad15270-35a8-4ec5-bc0a-fa08077f47c3`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:26,970::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:11:26,970::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079874', 'lastCheck': '1.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717981', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:11:26,971::task::1191::Storage.TaskManager.Task::(prepare) Task=`bad15270-35a8-4ec5-bc0a-fa08077f47c3`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079874', 'lastCheck': '1.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717981', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:11:26,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`bad15270-35a8-4ec5-bc0a-fa08077f47c3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:26,971::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:26,971::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:26,971::task::993::Storage.TaskManager.Task::(_decref) Task=`bad15270-35a8-4ec5-bc0a-fa08077f47c3`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:11:26,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:27,262::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:27,262::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:27,279::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:11:27,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:27,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120992 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:29,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:29,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0167901 s, 61.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:31,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:31,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121671 s, 84.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:32,285::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:32,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:32,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:11:32,728::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:11:32,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`93084359-be87-4b23-b396-ceed8c537afa`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:32,729::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:11:32,741::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:32,741::task::1191::Storage.TaskManager.Task::(prepare) Task=`93084359-be87-4b23-b396-ceed8c537afa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:32,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`93084359-be87-4b23-b396-ceed8c537afa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:32,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:32,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:32,742::task::993::Storage.TaskManager.Task::(_decref) Task=`93084359-be87-4b23-b396-ceed8c537afa`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:11:32,754::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:11:32,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`889b8efb-d19d-4fc9-a8be-61cb47252511`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:11:32,755::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:11:32,755::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`3cfd9664-5b3e-4f13-a323-801eeb656fb7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:11:32,755::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:11:32,756::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:11:32,756::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`3cfd9664-5b3e-4f13-a323-801eeb656fb7`::Granted request >Thread-32::DEBUG::2014-08-12 15:11:32,756::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`889b8efb-d19d-4fc9-a8be-61cb47252511`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:11:32,756::task::993::Storage.TaskManager.Task::(_decref) Task=`889b8efb-d19d-4fc9-a8be-61cb47252511`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:11:32,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:32,769::task::1191::Storage.TaskManager.Task::(prepare) Task=`889b8efb-d19d-4fc9-a8be-61cb47252511`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:32,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`889b8efb-d19d-4fc9-a8be-61cb47252511`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:11:32,769::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:11:32,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:11:32,770::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:11:32,770::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:11:32,770::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:11:32,770::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:11:32,771::task::993::Storage.TaskManager.Task::(_decref) Task=`889b8efb-d19d-4fc9-a8be-61cb47252511`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:11:33,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:33,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121576 s, 84.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:35,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:35,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121627 s, 84.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:11:35,857::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:11:35,869::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653236 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:11:35,872::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:11:35,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:35,873::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:35,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:35,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:35,873::__init__::225::IOProcess::(_processLogs) (14386) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:35,873::__init__::225::IOProcess::(_processLogs) (14386) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:35,873::__init__::225::IOProcess::(_processLogs) (14386) Building response >Thread-25::DEBUG::2014-08-12 15:11:35,874::__init__::225::IOProcess::(_processLogs) (14386) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:35,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:35,874::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:11:35,875::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:11:35,875::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:11:35,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:35,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:35,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:35,876::__init__::225::IOProcess::(_processLogs) (14387) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:35,876::__init__::225::IOProcess::(_processLogs) (14387) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:35,876::__init__::225::IOProcess::(_processLogs) (14387) Building response >Thread-25::DEBUG::2014-08-12 15:11:35,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:35,876::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:11:36,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:11:36,406::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571116 s, 7.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:37,303::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:37,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:37,320::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:11:37,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:37,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120825 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:39,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:39,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121101 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:41,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:41,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121126 s, 84.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:11:42,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6ec80fb-cc54-4d59-837f-3d60a2ac987f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:42,080::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:11:42,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653236', 'lastCheck': '6.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571116', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:11:42,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6ec80fb-cc54-4d59-837f-3d60a2ac987f`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653236', 'lastCheck': '6.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571116', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:11:42,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6ec80fb-cc54-4d59-837f-3d60a2ac987f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:42,081::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:42,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:42,081::task::993::Storage.TaskManager.Task::(_decref) Task=`b6ec80fb-cc54-4d59-837f-3d60a2ac987f`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:11:42,105::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:42,325::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:42,326::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:42,332::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:11:42,788::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:11:42,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`61f29d41-21c7-43de-a6aa-665864af6b1a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:42,788::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:11:42,830::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:42,831::task::1191::Storage.TaskManager.Task::(prepare) Task=`61f29d41-21c7-43de-a6aa-665864af6b1a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:42,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`61f29d41-21c7-43de-a6aa-665864af6b1a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:42,831::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:42,831::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:42,831::task::993::Storage.TaskManager.Task::(_decref) Task=`61f29d41-21c7-43de-a6aa-665864af6b1a`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:11:42,844::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:11:42,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`3136ec99-e09b-444c-8df1-2a2e568dc33f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:11:42,845::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:11:42,845::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ef18fc81-80a0-4db4-b7d0-13df8862b266`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:11:42,845::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:11:42,846::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:11:42,846::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ef18fc81-80a0-4db4-b7d0-13df8862b266`::Granted request >Thread-32::DEBUG::2014-08-12 15:11:42,846::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3136ec99-e09b-444c-8df1-2a2e568dc33f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:11:42,846::task::993::Storage.TaskManager.Task::(_decref) Task=`3136ec99-e09b-444c-8df1-2a2e568dc33f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:11:42,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:42,859::task::1191::Storage.TaskManager.Task::(prepare) Task=`3136ec99-e09b-444c-8df1-2a2e568dc33f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:42,859::task::595::Storage.TaskManager.Task::(_updateState) Task=`3136ec99-e09b-444c-8df1-2a2e568dc33f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:11:42,859::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:11:42,859::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:11:42,860::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:11:42,860::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:11:42,860::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:11:42,860::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:11:42,860::task::993::Storage.TaskManager.Task::(_decref) Task=`3136ec99-e09b-444c-8df1-2a2e568dc33f`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:11:43,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:44,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122032 s, 83.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:11:45,880::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:11:45,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579995 s, 7.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:11:45,910::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:11:45,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:45,911::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:11:45,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:45,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:45,914::__init__::225::IOProcess::(_processLogs) (14388) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:45,915::__init__::225::IOProcess::(_processLogs) (14388) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:45,916::__init__::225::IOProcess::(_processLogs) (14388) Building response >Thread-25::DEBUG::2014-08-12 15:11:45,917::__init__::225::IOProcess::(_processLogs) (14388) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:45,917::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:45,918::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:11:45,922::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:11:45,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:45,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:11:45,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:45,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:45,926::__init__::225::IOProcess::(_processLogs) (14389) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:45,927::__init__::225::IOProcess::(_processLogs) (14389) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:45,928::__init__::225::IOProcess::(_processLogs) (14389) Building response >Thread-25::DEBUG::2014-08-12 15:11:45,929::__init__::225::IOProcess::(_processLogs) (14389) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:45,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:45,931::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:11:46,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:46,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0199289 s, 51.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:11:46,408::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:11:46,421::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693236 s, 5.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:47,338::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:47,339::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:47,349::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:11:48,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:48,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121187 s, 84.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:50,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:50,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136115 s, 75.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:52,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:52,359::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:52,360::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:52,361::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:11:52,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122233 s, 83.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:11:52,876::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:11:52,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`fabc6d78-52d3-402a-bc56-33a270fb4374`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:52,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:11:52,910::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:52,911::task::1191::Storage.TaskManager.Task::(prepare) Task=`fabc6d78-52d3-402a-bc56-33a270fb4374`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:11:52,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`fabc6d78-52d3-402a-bc56-33a270fb4374`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:52,911::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:52,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:52,911::task::993::Storage.TaskManager.Task::(_decref) Task=`fabc6d78-52d3-402a-bc56-33a270fb4374`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:11:52,922::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:11:52,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd95c3ef-1ac1-4b04-9b4a-4d50725447d7`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:11:52,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:11:52,925::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`398cab6e-0b5d-417f-81bb-4a2320285293`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:11:52,925::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:11:52,926::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:11:52,926::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`398cab6e-0b5d-417f-81bb-4a2320285293`::Granted request >Thread-32::DEBUG::2014-08-12 15:11:52,926::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cd95c3ef-1ac1-4b04-9b4a-4d50725447d7`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:11:52,926::task::993::Storage.TaskManager.Task::(_decref) Task=`cd95c3ef-1ac1-4b04-9b4a-4d50725447d7`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:11:52,939::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:52,939::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd95c3ef-1ac1-4b04-9b4a-4d50725447d7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:11:52,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd95c3ef-1ac1-4b04-9b4a-4d50725447d7`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:11:52,939::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:11:52,939::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:11:52,940::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:11:52,940::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:11:52,940::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:11:52,940::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:11:52,940::task::993::Storage.TaskManager.Task::(_decref) Task=`cd95c3ef-1ac1-4b04-9b4a-4d50725447d7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-12 15:11:54,124::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:11:54,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:54,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124223 s, 82.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:11:55,935::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:11:55,949::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662155 s, 6.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:11:55,958::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:11:55,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:55,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:55,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:55,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:55,959::__init__::225::IOProcess::(_processLogs) (14390) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:55,959::__init__::225::IOProcess::(_processLogs) (14390) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:55,960::__init__::225::IOProcess::(_processLogs) (14390) Building response >Thread-25::DEBUG::2014-08-12 15:11:55,961::__init__::225::IOProcess::(_processLogs) (14390) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:55,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:55,961::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:11:55,962::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:11:55,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:11:55,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:11:55,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:11:55,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:11:55,963::__init__::225::IOProcess::(_processLogs) (14391) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:11:55,963::__init__::225::IOProcess::(_processLogs) (14391) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:11:55,963::__init__::225::IOProcess::(_processLogs) (14391) Building response >Thread-25::DEBUG::2014-08-12 15:11:55,963::__init__::225::IOProcess::(_processLogs) (14391) Queuing response >Thread-25::DEBUG::2014-08-12 15:11:55,963::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:11:55,963::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:11:56,423::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:11:56,434::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000556761 s, 7.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:11:56,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:56,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120595 s, 84.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:11:57,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`21d90d7f-8287-4bcf-bff6-d4fc32884e7e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:11:57,203::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:11:57,203::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662155', 'lastCheck': '1.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556761', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:11:57,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`21d90d7f-8287-4bcf-bff6-d4fc32884e7e`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662155', 'lastCheck': '1.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556761', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:11:57,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`21d90d7f-8287-4bcf-bff6-d4fc32884e7e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:11:57,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:11:57,204::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:11:57,204::task::993::Storage.TaskManager.Task::(_decref) Task=`21d90d7f-8287-4bcf-bff6-d4fc32884e7e`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:11:57,227::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:57,367::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:57,368::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:11:57,384::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-44::DEBUG::2014-08-12 15:11:58,256::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7f05c2f-3a35-4de3-83b3-2c5aa39f72fe`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:11:58,256::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:11:58,256::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:11:58,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7f05c2f-3a35-4de3-83b3-2c5aa39f72fe`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:11:58,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7f05c2f-3a35-4de3-83b3-2c5aa39f72fe`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:11:58,257::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:11:58,257::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:11:58,257::task::993::Storage.TaskManager.Task::(_decref) Task=`e7f05c2f-3a35-4de3-83b3-2c5aa39f72fe`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:11:58,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9e11e55-c702-496d-a7b3-277fea6e789d`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:11:58,258::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:11:58,258::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:11:58,258::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9e11e55-c702-496d-a7b3-277fea6e789d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:11:58,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9e11e55-c702-496d-a7b3-277fea6e789d`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:11:58,258::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:11:58,258::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:11:58,259::task::993::Storage.TaskManager.Task::(_decref) Task=`e9e11e55-c702-496d-a7b3-277fea6e789d`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:11:58,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c02f3e9-6cb5-4b37-a0e7-206cf307f71a`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:11:58,259::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:11:58,259::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:11:58,260::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c02f3e9-6cb5-4b37-a0e7-206cf307f71a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:11:58,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c02f3e9-6cb5-4b37-a0e7-206cf307f71a`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:11:58,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:11:58,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:11:58,260::task::993::Storage.TaskManager.Task::(_decref) Task=`8c02f3e9-6cb5-4b37-a0e7-206cf307f71a`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:11:58,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcb86e53-40a1-44a5-810c-13c2276ab110`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:11:58,261::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:11:58,261::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:11:58,261::task::1191::Storage.TaskManager.Task::(prepare) Task=`fcb86e53-40a1-44a5-810c-13c2276ab110`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:11:58,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcb86e53-40a1-44a5-810c-13c2276ab110`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:11:58,261::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:11:58,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:11:58,262::task::993::Storage.TaskManager.Task::(_decref) Task=`fcb86e53-40a1-44a5-810c-13c2276ab110`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:11:58,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:11:58,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012089 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:00,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:00,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121252 s, 84.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:02,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:02,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:02,396::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:12:02,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:02,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01587 s, 64.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:12:02,957::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [12e8aff0] >Thread-14::DEBUG::2014-08-12 15:12:02,958::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fa4e627-dc6e-4cd6-8561-9bca49e8ef65`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:02,958::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:12:02,998::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:02,998::task::1191::Storage.TaskManager.Task::(prepare) Task=`4fa4e627-dc6e-4cd6-8561-9bca49e8ef65`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:02,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fa4e627-dc6e-4cd6-8561-9bca49e8ef65`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:02,998::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:02,999::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:02,999::task::993::Storage.TaskManager.Task::(_decref) Task=`4fa4e627-dc6e-4cd6-8561-9bca49e8ef65`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:12:03,010::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [12e8aff0] >Thread-32::DEBUG::2014-08-12 15:12:03,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`95df384d-3896-4d5d-a0c7-78a785c4434c`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:12:03,011::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:12:03,012::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`531822ac-e79e-41b9-8222-a9dd3d7d6926`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:12:03,012::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:12:03,012::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:12:03,012::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`531822ac-e79e-41b9-8222-a9dd3d7d6926`::Granted request >Thread-32::DEBUG::2014-08-12 15:12:03,013::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`95df384d-3896-4d5d-a0c7-78a785c4434c`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:12:03,013::task::993::Storage.TaskManager.Task::(_decref) Task=`95df384d-3896-4d5d-a0c7-78a785c4434c`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:12:03,025::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:03,025::task::1191::Storage.TaskManager.Task::(prepare) Task=`95df384d-3896-4d5d-a0c7-78a785c4434c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:03,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`95df384d-3896-4d5d-a0c7-78a785c4434c`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:12:03,026::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:12:03,026::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:12:03,026::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:12:03,026::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:12:03,027::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:12:03,027::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:12:03,027::task::993::Storage.TaskManager.Task::(_decref) Task=`95df384d-3896-4d5d-a0c7-78a785c4434c`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:12:04,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:04,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011984 s, 85.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:12:05,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:12:05,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674297 s, 6.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:12:05,980::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:12:05,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:05,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:05,980::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:05,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:05,981::__init__::225::IOProcess::(_processLogs) (14392) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:05,981::__init__::225::IOProcess::(_processLogs) (14392) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:05,981::__init__::225::IOProcess::(_processLogs) (14392) Building response >Thread-25::DEBUG::2014-08-12 15:12:05,981::__init__::225::IOProcess::(_processLogs) (14392) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:05,981::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:05,981::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:12:05,982::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:12:05,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:05,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:05,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:05,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:05,983::__init__::225::IOProcess::(_processLogs) (14393) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:05,983::__init__::225::IOProcess::(_processLogs) (14393) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:05,984::__init__::225::IOProcess::(_processLogs) (14393) Building response >Thread-25::DEBUG::2014-08-12 15:12:05,984::__init__::225::IOProcess::(_processLogs) (14393) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:05,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:05,984::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:12:06,436::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:12:06,447::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062391 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:06,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:06,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012082 s, 84.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:07,402::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:07,403::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:07,419::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:12:08,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:08,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120726 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:10,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:11,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121617 s, 84.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:12:12,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`eff3c37b-217e-411d-85c9-e5c68cfaff22`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:12,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:12:12,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674297', 'lastCheck': '6.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062391', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:12:12,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`eff3c37b-217e-411d-85c9-e5c68cfaff22`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674297', 'lastCheck': '6.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062391', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:12:12,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`eff3c37b-217e-411d-85c9-e5c68cfaff22`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:12,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:12,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:12,320::task::993::Storage.TaskManager.Task::(_decref) Task=`eff3c37b-217e-411d-85c9-e5c68cfaff22`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:12:12,343::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:12,425::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:12,426::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:12,437::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:12:13,042::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:12:13,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`08c38643-993c-41ee-ad74-af51f9e003d9`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:13,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Dummy-31::DEBUG::2014-08-12 15:12:13,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::INFO::2014-08-12 15:12:13,120::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Dummy-31::DEBUG::2014-08-12 15:12:13,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118343 s, 86.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:12:13,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`08c38643-993c-41ee-ad74-af51f9e003d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:13,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`08c38643-993c-41ee-ad74-af51f9e003d9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:13,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:13,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:13,126::task::993::Storage.TaskManager.Task::(_decref) Task=`08c38643-993c-41ee-ad74-af51f9e003d9`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:12:13,141::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:12:13,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7c927c3-5080-4d99-971b-06c775122441`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:12:13,142::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:12:13,142::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`bab6ce5e-cc8d-4d61-b6d8-ffd43033c202`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:12:13,142::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:12:13,143::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:12:13,143::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`bab6ce5e-cc8d-4d61-b6d8-ffd43033c202`::Granted request >Thread-32::DEBUG::2014-08-12 15:12:13,143::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d7c927c3-5080-4d99-971b-06c775122441`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:12:13,143::task::993::Storage.TaskManager.Task::(_decref) Task=`d7c927c3-5080-4d99-971b-06c775122441`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:12:13,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:13,156::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7c927c3-5080-4d99-971b-06c775122441`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:13,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7c927c3-5080-4d99-971b-06c775122441`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:12:13,156::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:12:13,157::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:12:13,157::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:12:13,157::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:12:13,157::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:12:13,157::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:12:13,158::task::993::Storage.TaskManager.Task::(_decref) Task=`d7c927c3-5080-4d99-971b-06c775122441`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:12:15,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:15,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128446 s, 79.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:12:15,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:12:16,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073362 s, 5.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:12:16,015::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:12:16,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:16,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:12:16,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:16,019::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:16,019::__init__::225::IOProcess::(_processLogs) (14394) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:16,020::__init__::225::IOProcess::(_processLogs) (14394) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:16,021::__init__::225::IOProcess::(_processLogs) (14394) Building response >Thread-25::DEBUG::2014-08-12 15:12:16,022::__init__::225::IOProcess::(_processLogs) (14394) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:16,023::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:16,024::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:12:16,027::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:12:16,028::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:16,029::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:12:16,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:16,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:16,031::__init__::225::IOProcess::(_processLogs) (14395) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:16,032::__init__::225::IOProcess::(_processLogs) (14395) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:16,033::__init__::225::IOProcess::(_processLogs) (14395) Building response >Thread-25::DEBUG::2014-08-12 15:12:16,034::__init__::225::IOProcess::(_processLogs) (14395) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:16,034::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:16,035::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:12:16,450::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:12:16,463::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659538 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:17,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:17,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013105 s, 78.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:17,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:17,444::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:17,448::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:12:19,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:19,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131775 s, 77.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:21,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:21,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013388 s, 76.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:22,455::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:22,456::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:22,466::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:12:23,172::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:12:23,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e25fa35-9681-4061-b830-cbef65ec2952`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:23,173::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:12:23,214::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:23,214::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e25fa35-9681-4061-b830-cbef65ec2952`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:23,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e25fa35-9681-4061-b830-cbef65ec2952`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:23,214::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:23,214::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:23,215::task::993::Storage.TaskManager.Task::(_decref) Task=`2e25fa35-9681-4061-b830-cbef65ec2952`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:12:23,226::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:12:23,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e20f47f-56f5-45c2-af4b-8afeb3d394bb`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:12:23,227::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:12:23,227::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`dcf92902-dae1-4926-af81-1e94bfcb42d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:12:23,227::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:12:23,227::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:12:23,228::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`dcf92902-dae1-4926-af81-1e94bfcb42d4`::Granted request >Thread-32::DEBUG::2014-08-12 15:12:23,228::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2e20f47f-56f5-45c2-af4b-8afeb3d394bb`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:12:23,228::task::993::Storage.TaskManager.Task::(_decref) Task=`2e20f47f-56f5-45c2-af4b-8afeb3d394bb`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:12:23,241::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:23,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e20f47f-56f5-45c2-af4b-8afeb3d394bb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:23,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e20f47f-56f5-45c2-af4b-8afeb3d394bb`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:12:23,241::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:12:23,241::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:12:23,242::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:12:23,242::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:12:23,242::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:12:23,242::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:12:23,242::task::993::Storage.TaskManager.Task::(_decref) Task=`2e20f47f-56f5-45c2-af4b-8afeb3d394bb`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:12:23,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:23,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121808 s, 84.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:12:24,164::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:12:25,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:25,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120754 s, 84.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:12:26,039::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:12:26,051::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634967 s, 6.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:12:26,054::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:12:26,055::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:26,055::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:26,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:26,055::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:26,055::__init__::225::IOProcess::(_processLogs) (14396) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:26,055::__init__::225::IOProcess::(_processLogs) (14396) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:26,056::__init__::225::IOProcess::(_processLogs) (14396) Building response >Thread-25::DEBUG::2014-08-12 15:12:26,056::__init__::225::IOProcess::(_processLogs) (14396) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:26,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:26,056::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:12:26,057::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:12:26,057::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:26,057::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:26,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:26,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:26,058::__init__::225::IOProcess::(_processLogs) (14397) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:26,058::__init__::225::IOProcess::(_processLogs) (14397) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:26,058::__init__::225::IOProcess::(_processLogs) (14397) Building response >Thread-25::DEBUG::2014-08-12 15:12:26,058::__init__::225::IOProcess::(_processLogs) (14397) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:26,058::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:26,059::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:12:26,467::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:12:26,478::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677584 s, 6.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:12:27,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`907bbb3a-ac3b-4139-b295-c6f4356ecf45`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:27,452::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:12:27,452::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634967', 'lastCheck': '1.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677584', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:12:27,453::task::1191::Storage.TaskManager.Task::(prepare) Task=`907bbb3a-ac3b-4139-b295-c6f4356ecf45`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634967', 'lastCheck': '1.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677584', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:12:27,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`907bbb3a-ac3b-4139-b295-c6f4356ecf45`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:27,453::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:27,453::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:27,453::task::993::Storage.TaskManager.Task::(_decref) Task=`907bbb3a-ac3b-4139-b295-c6f4356ecf45`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:27,472::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:27,473::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:12:27,479::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:27,498::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:12:27,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:27,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012143 s, 84.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:29,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:29,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120633 s, 84.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:31,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:31,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131148 s, 78.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:32,507::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:32,507::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:32,519::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:12:33,257::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:12:33,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`897d882f-aa4c-442e-84e8-396af518cc5c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:33,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:12:33,294::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:33,294::task::1191::Storage.TaskManager.Task::(prepare) Task=`897d882f-aa4c-442e-84e8-396af518cc5c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:33,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`897d882f-aa4c-442e-84e8-396af518cc5c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:33,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:33,295::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:33,295::task::993::Storage.TaskManager.Task::(_decref) Task=`897d882f-aa4c-442e-84e8-396af518cc5c`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:12:33,307::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:12:33,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`912de01c-33b0-41f5-b33b-a922d733f588`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:12:33,307::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:12:33,308::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8737ec2d-f64f-4756-bba7-67c3d756b548`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:12:33,308::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:12:33,308::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:12:33,309::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8737ec2d-f64f-4756-bba7-67c3d756b548`::Granted request >Thread-32::DEBUG::2014-08-12 15:12:33,309::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`912de01c-33b0-41f5-b33b-a922d733f588`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:12:33,309::task::993::Storage.TaskManager.Task::(_decref) Task=`912de01c-33b0-41f5-b33b-a922d733f588`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:12:33,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:33,322::task::1191::Storage.TaskManager.Task::(prepare) Task=`912de01c-33b0-41f5-b33b-a922d733f588`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:33,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`912de01c-33b0-41f5-b33b-a922d733f588`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:12:33,322::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:12:33,322::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:12:33,322::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:12:33,323::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:12:33,323::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:12:33,323::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:12:33,323::task::993::Storage.TaskManager.Task::(_decref) Task=`912de01c-33b0-41f5-b33b-a922d733f588`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:12:33,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:33,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120087 s, 85.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:35,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:35,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120898 s, 84.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:12:36,060::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:12:36,072::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681931 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:12:36,075::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:12:36,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:36,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:36,076::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:36,076::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:36,076::__init__::225::IOProcess::(_processLogs) (14398) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:36,077::__init__::225::IOProcess::(_processLogs) (14398) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:36,077::__init__::225::IOProcess::(_processLogs) (14398) Building response >Thread-25::DEBUG::2014-08-12 15:12:36,077::__init__::225::IOProcess::(_processLogs) (14398) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:36,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:36,077::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:12:36,078::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:12:36,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:36,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:36,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:36,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:36,079::__init__::225::IOProcess::(_processLogs) (14399) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:36,079::__init__::225::IOProcess::(_processLogs) (14399) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:36,079::__init__::225::IOProcess::(_processLogs) (14399) Building response >Thread-25::DEBUG::2014-08-12 15:12:36,079::__init__::225::IOProcess::(_processLogs) (14399) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:36,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:36,080::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:12:36,480::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:12:36,491::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653041 s, 6.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:37,520::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:37,521::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:37,536::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:12:37,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:37,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119898 s, 85.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:40,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:40,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120667 s, 84.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:42,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:42,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120267 s, 85.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:42,538::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:42,539::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:42,548::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:12:42,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`686ca1a9-71da-47a4-a2b2-f0bfda4aac56`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:42,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:12:42,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681931', 'lastCheck': '6.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653041', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:12:42,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`686ca1a9-71da-47a4-a2b2-f0bfda4aac56`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681931', 'lastCheck': '6.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653041', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:12:42,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`686ca1a9-71da-47a4-a2b2-f0bfda4aac56`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:42,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:42,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:42,602::task::993::Storage.TaskManager.Task::(_decref) Task=`686ca1a9-71da-47a4-a2b2-f0bfda4aac56`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:12:42,625::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:12:43,339::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:12:43,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`29f4beaf-161e-4070-ac16-ee146e43637c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:43,340::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:12:43,384::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:43,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`29f4beaf-161e-4070-ac16-ee146e43637c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:43,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`29f4beaf-161e-4070-ac16-ee146e43637c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:43,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:43,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:43,385::task::993::Storage.TaskManager.Task::(_decref) Task=`29f4beaf-161e-4070-ac16-ee146e43637c`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:12:43,396::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:12:43,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0386f06-6a22-4649-b9a2-94f822c97c16`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:12:43,397::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:12:43,397::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`59fe2736-f29d-4f10-a0e3-305ae39b1134`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:12:43,398::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:12:43,398::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:12:43,398::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`59fe2736-f29d-4f10-a0e3-305ae39b1134`::Granted request >Thread-32::DEBUG::2014-08-12 15:12:43,400::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b0386f06-6a22-4649-b9a2-94f822c97c16`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:12:43,400::task::993::Storage.TaskManager.Task::(_decref) Task=`b0386f06-6a22-4649-b9a2-94f822c97c16`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:12:43,413::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:43,413::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0386f06-6a22-4649-b9a2-94f822c97c16`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:43,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0386f06-6a22-4649-b9a2-94f822c97c16`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:12:43,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:12:43,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:12:43,414::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:12:43,414::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:12:43,414::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:12:43,415::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:12:43,415::task::993::Storage.TaskManager.Task::(_decref) Task=`b0386f06-6a22-4649-b9a2-94f822c97c16`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:12:44,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:44,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120688 s, 84.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:12:46,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:12:46,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684918 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:12:46,110::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:12:46,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:46,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:12:46,113::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:46,113::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:46,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:46,115::__init__::225::IOProcess::(_processLogs) (14400) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:46,116::__init__::225::IOProcess::(_processLogs) (14400) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:46,117::__init__::225::IOProcess::(_processLogs) (14400) Building response >Thread-25::DEBUG::2014-08-12 15:12:46,118::__init__::225::IOProcess::(_processLogs) (14400) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:46,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:46,119::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:12:46,123::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:12:46,124::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:12:46,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:46,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:12:46,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:46,127::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:46,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:46,129::__init__::225::IOProcess::(_processLogs) (14401) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:46,130::__init__::225::IOProcess::(_processLogs) (14401) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:46,130::__init__::225::IOProcess::(_processLogs) (14401) Building response >Thread-25::DEBUG::2014-08-12 15:12:46,131::__init__::225::IOProcess::(_processLogs) (14401) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:46,132::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:46,133::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:12:46,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:46,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181775 s, 56.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:12:46,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:12:46,506::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685143 s, 6.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:47,554::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:47,555::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:47,565::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:12:48,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:48,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121243 s, 84.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:50,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:50,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133102 s, 76.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:52,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:52,572::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:52,573::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:52,574::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:12:52,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120254 s, 85.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:12:53,432::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:12:53,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`e815ab83-8c4e-49d7-bd37-b5903446c425`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:53,433::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:12:53,471::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:53,471::task::1191::Storage.TaskManager.Task::(prepare) Task=`e815ab83-8c4e-49d7-bd37-b5903446c425`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:12:53,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`e815ab83-8c4e-49d7-bd37-b5903446c425`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:53,471::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:53,471::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:53,472::task::993::Storage.TaskManager.Task::(_decref) Task=`e815ab83-8c4e-49d7-bd37-b5903446c425`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:12:53,486::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:12:53,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7fd630c-f720-4039-8d44-729ae9d8d165`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:12:53,487::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:12:53,487::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d7355483-b05e-47c0-bc11-a9136d1ba5a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:12:53,487::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:12:53,488::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:12:53,488::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d7355483-b05e-47c0-bc11-a9136d1ba5a8`::Granted request >Thread-32::DEBUG::2014-08-12 15:12:53,488::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a7fd630c-f720-4039-8d44-729ae9d8d165`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:12:53,488::task::993::Storage.TaskManager.Task::(_decref) Task=`a7fd630c-f720-4039-8d44-729ae9d8d165`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:12:53,501::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:53,501::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7fd630c-f720-4039-8d44-729ae9d8d165`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:12:53,501::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7fd630c-f720-4039-8d44-729ae9d8d165`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:12:53,501::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:12:53,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:12:53,502::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:12:53,502::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:12:53,502::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:12:53,502::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:12:53,503::task::993::Storage.TaskManager.Task::(_decref) Task=`a7fd630c-f720-4039-8d44-729ae9d8d165`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-12 15:12:54,223::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:12:54,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:54,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122132 s, 83.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:12:56,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:12:56,148::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000553854 s, 7.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:12:56,151::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:12:56,152::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:12:56,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:56,152::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:12:56,152::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:56,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:56,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:56,153::__init__::225::IOProcess::(_processLogs) (14402) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:56,153::__init__::225::IOProcess::(_processLogs) (14402) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:56,153::__init__::225::IOProcess::(_processLogs) (14402) Building response >Thread-25::DEBUG::2014-08-12 15:12:56,153::__init__::225::IOProcess::(_processLogs) (14402) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:56,153::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:56,153::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:12:56,154::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:12:56,154::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:12:56,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:12:56,155::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:12:56,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:12:56,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:12:56,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:12:56,155::__init__::225::IOProcess::(_processLogs) (14403) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:12:56,155::__init__::225::IOProcess::(_processLogs) (14403) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:12:56,156::__init__::225::IOProcess::(_processLogs) (14403) Building response >Thread-25::DEBUG::2014-08-12 15:12:56,156::__init__::225::IOProcess::(_processLogs) (14403) Queuing response >Thread-25::DEBUG::2014-08-12 15:12:56,156::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:12:56,156::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:12:56,509::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:12:56,520::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000539117 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:12:56,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:56,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120307 s, 85.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:57,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:57,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:12:57,600::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:12:57,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef51532e-7802-4553-bedb-64a0ea8a209f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:12:57,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:12:57,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553854', 'lastCheck': '1.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539117', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:12:57,714::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef51532e-7802-4553-bedb-64a0ea8a209f`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553854', 'lastCheck': '1.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539117', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:12:57,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef51532e-7802-4553-bedb-64a0ea8a209f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:12:57,715::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:12:57,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:12:57,715::task::993::Storage.TaskManager.Task::(_decref) Task=`ef51532e-7802-4553-bedb-64a0ea8a209f`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:12:57,736::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:12:58,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:12:58,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119521 s, 85.7 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:12:59,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2b6a1c5-5031-4605-b500-6b1df14d278a`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:12:59,133::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:12:59,133::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:12:59,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2b6a1c5-5031-4605-b500-6b1df14d278a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:12:59,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2b6a1c5-5031-4605-b500-6b1df14d278a`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:12:59,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:12:59,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:12:59,134::task::993::Storage.TaskManager.Task::(_decref) Task=`c2b6a1c5-5031-4605-b500-6b1df14d278a`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:12:59,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d7d9855-076c-4e13-aee7-77aa4125c1b9`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:12:59,134::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:12:59,135::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:12:59,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d7d9855-076c-4e13-aee7-77aa4125c1b9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:12:59,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d7d9855-076c-4e13-aee7-77aa4125c1b9`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:12:59,135::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:12:59,135::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:12:59,136::task::993::Storage.TaskManager.Task::(_decref) Task=`9d7d9855-076c-4e13-aee7-77aa4125c1b9`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:12:59,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5cd2210-d228-469e-b5d1-24ab8147b547`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:12:59,136::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:12:59,136::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:12:59,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5cd2210-d228-469e-b5d1-24ab8147b547`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:12:59,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5cd2210-d228-469e-b5d1-24ab8147b547`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:12:59,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:12:59,137::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:12:59,137::task::993::Storage.TaskManager.Task::(_decref) Task=`a5cd2210-d228-469e-b5d1-24ab8147b547`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:12:59,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`0763193c-d0a4-4140-beb2-5dc5e1f78692`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:12:59,138::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:12:59,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:12:59,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`0763193c-d0a4-4140-beb2-5dc5e1f78692`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:12:59,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`0763193c-d0a4-4140-beb2-5dc5e1f78692`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:12:59,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:12:59,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:12:59,139::task::993::Storage.TaskManager.Task::(_decref) Task=`0763193c-d0a4-4140-beb2-5dc5e1f78692`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:13:00,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:00,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122041 s, 83.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:02,607::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:02,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:02,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:02,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:02,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.015129 s, 67.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:13:03,520::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:13:03,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cf21f23-3022-4f3c-bfbe-99703daa5cc6`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:03,520::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:13:03,552::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:03,552::task::1191::Storage.TaskManager.Task::(prepare) Task=`4cf21f23-3022-4f3c-bfbe-99703daa5cc6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:03,552::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cf21f23-3022-4f3c-bfbe-99703daa5cc6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:03,552::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:03,552::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:03,553::task::993::Storage.TaskManager.Task::(_decref) Task=`4cf21f23-3022-4f3c-bfbe-99703daa5cc6`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:13:03,565::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:13:03,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`651f42ad-f686-4e24-bfc9-5dd9d0e0f732`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:13:03,565::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:13:03,566::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2ba112cf-ae64-4ade-8c4c-2425792ee523`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:13:03,566::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:13:03,566::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:13:03,566::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2ba112cf-ae64-4ade-8c4c-2425792ee523`::Granted request >Thread-32::DEBUG::2014-08-12 15:13:03,567::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`651f42ad-f686-4e24-bfc9-5dd9d0e0f732`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:13:03,567::task::993::Storage.TaskManager.Task::(_decref) Task=`651f42ad-f686-4e24-bfc9-5dd9d0e0f732`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:13:03,580::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:03,580::task::1191::Storage.TaskManager.Task::(prepare) Task=`651f42ad-f686-4e24-bfc9-5dd9d0e0f732`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:03,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`651f42ad-f686-4e24-bfc9-5dd9d0e0f732`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:13:03,580::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:13:03,580::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:13:03,580::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:13:03,581::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:13:03,581::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:13:03,581::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:13:03,581::task::993::Storage.TaskManager.Task::(_decref) Task=`651f42ad-f686-4e24-bfc9-5dd9d0e0f732`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:13:04,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:05,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127285 s, 80.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:13:06,158::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:13:06,170::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589258 s, 7.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:13:06,173::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:06,173::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:13:06,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:06,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:06,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:06,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:06,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:06,174::__init__::225::IOProcess::(_processLogs) (14404) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:06,174::__init__::225::IOProcess::(_processLogs) (14404) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:06,175::__init__::225::IOProcess::(_processLogs) (14404) Building response >Thread-25::DEBUG::2014-08-12 15:13:06,175::__init__::225::IOProcess::(_processLogs) (14404) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:06,175::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:06,175::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:13:06,176::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:06,176::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:13:06,176::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:06,176::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:06,176::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:06,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:06,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:06,177::__init__::225::IOProcess::(_processLogs) (14405) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:06,177::__init__::225::IOProcess::(_processLogs) (14405) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:06,177::__init__::225::IOProcess::(_processLogs) (14405) Building response >Thread-25::DEBUG::2014-08-12 15:13:06,177::__init__::225::IOProcess::(_processLogs) (14405) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:06,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:06,178::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:13:06,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:13:06,533::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571207 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:07,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:07,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125815 s, 81.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:07,624::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:07,625::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:07,641::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:09,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:09,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119121 s, 86.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:11,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:11,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012054 s, 85.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:12,648::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:12,649::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:12,653::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:13:12,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`35c03ae0-54fa-4321-81ed-130bed22d2ce`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:12,829::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:13:12,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589258', 'lastCheck': '6.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571207', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:13:12,829::task::1191::Storage.TaskManager.Task::(prepare) Task=`35c03ae0-54fa-4321-81ed-130bed22d2ce`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589258', 'lastCheck': '6.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571207', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:13:12,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`35c03ae0-54fa-4321-81ed-130bed22d2ce`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:12,830::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:12,830::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:12,830::task::993::Storage.TaskManager.Task::(_decref) Task=`35c03ae0-54fa-4321-81ed-130bed22d2ce`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:13:12,851::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:13,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:13,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119412 s, 85.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:13:13,596::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [42db2bf0] >Thread-14::DEBUG::2014-08-12 15:13:13,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`4386c087-a6d4-4f1f-a326-afe6c8e2bcf5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:13,597::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:13:13,632::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:13,632::task::1191::Storage.TaskManager.Task::(prepare) Task=`4386c087-a6d4-4f1f-a326-afe6c8e2bcf5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:13,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`4386c087-a6d4-4f1f-a326-afe6c8e2bcf5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:13,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:13,632::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:13,633::task::993::Storage.TaskManager.Task::(_decref) Task=`4386c087-a6d4-4f1f-a326-afe6c8e2bcf5`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:13:13,648::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [42db2bf0] >Thread-32::DEBUG::2014-08-12 15:13:13,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`c73ee024-d8c7-43db-98a8-ad36336d053d`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:13:13,648::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:13:13,649::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9bb535fe-7537-4639-a85f-70980aad79c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:13:13,649::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:13:13,649::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:13:13,650::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9bb535fe-7537-4639-a85f-70980aad79c7`::Granted request >Thread-32::DEBUG::2014-08-12 15:13:13,650::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c73ee024-d8c7-43db-98a8-ad36336d053d`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:13:13,650::task::993::Storage.TaskManager.Task::(_decref) Task=`c73ee024-d8c7-43db-98a8-ad36336d053d`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:13:13,664::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:13,665::task::1191::Storage.TaskManager.Task::(prepare) Task=`c73ee024-d8c7-43db-98a8-ad36336d053d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:13,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`c73ee024-d8c7-43db-98a8-ad36336d053d`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:13:13,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:13:13,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:13:13,665::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:13:13,666::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:13:13,666::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:13:13,666::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:13:13,666::task::993::Storage.TaskManager.Task::(_decref) Task=`c73ee024-d8c7-43db-98a8-ad36336d053d`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:13:15,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:15,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01233 s, 83.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:13:16,181::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:13:16,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797427 s, 5.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:13:16,211::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:16,212::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:13:16,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:16,214::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:16,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:16,216::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:16,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:16,219::__init__::225::IOProcess::(_processLogs) (14406) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:16,220::__init__::225::IOProcess::(_processLogs) (14406) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:16,221::__init__::225::IOProcess::(_processLogs) (14406) Building response >Thread-25::DEBUG::2014-08-12 15:13:16,222::__init__::225::IOProcess::(_processLogs) (14406) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:16,223::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:16,224::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:13:16,228::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:16,229::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:13:16,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:16,231::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:16,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:16,233::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:16,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:16,235::__init__::225::IOProcess::(_processLogs) (14407) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:16,235::__init__::225::IOProcess::(_processLogs) (14407) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:16,236::__init__::225::IOProcess::(_processLogs) (14407) Building response >Thread-25::DEBUG::2014-08-12 15:13:16,237::__init__::225::IOProcess::(_processLogs) (14407) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:16,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:16,239::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:13:16,536::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:13:16,548::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578625 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:17,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:17,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119108 s, 86.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:17,659::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:17,660::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:17,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:19,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:19,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011946 s, 85.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:21,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:21,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125007 s, 81.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:22,677::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:22,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:22,689::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:23,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:23,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118892 s, 86.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:13:23,703::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:13:23,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`b113a781-e381-4779-a03a-2689f3198fd6`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:23,705::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:13:23,736::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:23,736::task::1191::Storage.TaskManager.Task::(prepare) Task=`b113a781-e381-4779-a03a-2689f3198fd6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:23,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`b113a781-e381-4779-a03a-2689f3198fd6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:23,736::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:23,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:23,737::task::993::Storage.TaskManager.Task::(_decref) Task=`b113a781-e381-4779-a03a-2689f3198fd6`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:13:23,748::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:13:23,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a559742-6ce8-4ece-9a48-d34a24a01a16`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:13:23,748::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:13:23,749::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`67f50f8c-bb25-4983-bc87-bce7921590ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:13:23,749::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:13:23,749::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:13:23,749::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`67f50f8c-bb25-4983-bc87-bce7921590ca`::Granted request >Thread-32::DEBUG::2014-08-12 15:13:23,750::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2a559742-6ce8-4ece-9a48-d34a24a01a16`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:13:23,750::task::993::Storage.TaskManager.Task::(_decref) Task=`2a559742-6ce8-4ece-9a48-d34a24a01a16`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:13:23,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:23,762::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a559742-6ce8-4ece-9a48-d34a24a01a16`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:23,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a559742-6ce8-4ece-9a48-d34a24a01a16`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:13:23,763::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:13:23,763::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:13:23,763::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:13:23,763::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:13:23,764::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:13:23,764::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:13:23,764::task::993::Storage.TaskManager.Task::(_decref) Task=`2a559742-6ce8-4ece-9a48-d34a24a01a16`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-12 15:13:24,285::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:13:25,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:25,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120087 s, 85.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:13:26,242::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:13:26,254::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585663 s, 7.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:13:26,257::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:26,258::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:13:26,258::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:26,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:26,258::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:26,258::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:26,258::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:26,259::__init__::225::IOProcess::(_processLogs) (14408) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:26,259::__init__::225::IOProcess::(_processLogs) (14408) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:26,259::__init__::225::IOProcess::(_processLogs) (14408) Building response >Thread-25::DEBUG::2014-08-12 15:13:26,259::__init__::225::IOProcess::(_processLogs) (14408) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:26,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:26,259::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:13:26,260::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:26,260::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:13:26,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:26,261::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:26,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:26,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:26,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:26,261::__init__::225::IOProcess::(_processLogs) (14409) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:26,261::__init__::225::IOProcess::(_processLogs) (14409) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:26,261::__init__::225::IOProcess::(_processLogs) (14409) Building response >Thread-25::DEBUG::2014-08-12 15:13:26,262::__init__::225::IOProcess::(_processLogs) (14409) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:26,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:26,262::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:13:26,552::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:13:26,561::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572369 s, 7.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:27,695::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:27,696::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:27,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:27,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:27,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119984 s, 85.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:13:27,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9802d46-e84a-40ba-88b7-33dba8d6edd8`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:27,952::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:13:27,953::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585663', 'lastCheck': '1.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572369', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:13:27,953::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9802d46-e84a-40ba-88b7-33dba8d6edd8`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585663', 'lastCheck': '1.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572369', 'lastCheck': '1.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:13:27,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9802d46-e84a-40ba-88b7-33dba8d6edd8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:27,953::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:27,953::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:27,954::task::993::Storage.TaskManager.Task::(_decref) Task=`c9802d46-e84a-40ba-88b7-33dba8d6edd8`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:13:27,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:29,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:29,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122024 s, 83.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:31,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:31,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118986 s, 86.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:32,718::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:32,719::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:32,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:13:33,780::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:13:33,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbd1e31c-bdc4-47cd-a35a-c7a0121e7ed2`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:33,781::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:13:33,793::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:33,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbd1e31c-bdc4-47cd-a35a-c7a0121e7ed2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:33,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbd1e31c-bdc4-47cd-a35a-c7a0121e7ed2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:33,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:33,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:33,794::task::993::Storage.TaskManager.Task::(_decref) Task=`bbd1e31c-bdc4-47cd-a35a-c7a0121e7ed2`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:13:33,804::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:13:33,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa2f7170-2df4-42fb-9f08-17e3984dc34d`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:13:33,805::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:13:33,805::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c661291b-2f66-42bb-902c-7a0505165a6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:13:33,806::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:13:33,806::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:13:33,806::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c661291b-2f66-42bb-902c-7a0505165a6c`::Granted request >Thread-32::DEBUG::2014-08-12 15:13:33,806::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fa2f7170-2df4-42fb-9f08-17e3984dc34d`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:13:33,807::task::993::Storage.TaskManager.Task::(_decref) Task=`fa2f7170-2df4-42fb-9f08-17e3984dc34d`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:13:33,819::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:33,819::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa2f7170-2df4-42fb-9f08-17e3984dc34d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:33,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa2f7170-2df4-42fb-9f08-17e3984dc34d`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:13:33,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:13:33,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:13:33,820::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:13:33,820::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:13:33,820::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:13:33,820::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:13:33,820::task::993::Storage.TaskManager.Task::(_decref) Task=`fa2f7170-2df4-42fb-9f08-17e3984dc34d`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:13:34,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:34,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012032 s, 85.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:36,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:36,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012173 s, 84.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:13:36,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:13:36,276::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000758653 s, 5.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:13:36,279::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:36,279::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:13:36,279::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:36,279::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:36,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:36,280::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:36,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:36,280::__init__::225::IOProcess::(_processLogs) (14410) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:36,280::__init__::225::IOProcess::(_processLogs) (14410) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:36,280::__init__::225::IOProcess::(_processLogs) (14410) Building response >Thread-25::DEBUG::2014-08-12 15:13:36,280::__init__::225::IOProcess::(_processLogs) (14410) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:36,281::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:36,281::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:13:36,282::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:36,282::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:13:36,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:36,282::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:36,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:36,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:36,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:36,283::__init__::225::IOProcess::(_processLogs) (14411) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:36,283::__init__::225::IOProcess::(_processLogs) (14411) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:36,283::__init__::225::IOProcess::(_processLogs) (14411) Building response >Thread-25::DEBUG::2014-08-12 15:13:36,283::__init__::225::IOProcess::(_processLogs) (14411) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:36,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:36,283::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:13:36,563::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:13:36,574::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611219 s, 6.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:37,736::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:37,737::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:37,753::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:38,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:38,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118263 s, 86.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:40,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:40,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013448 s, 76.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:42,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:42,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0159591 s, 64.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:42,760::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:42,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:42,765::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:13:43,102::task::595::Storage.TaskManager.Task::(_updateState) Task=`27bf4161-b044-401a-876e-41414db20046`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:43,102::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:13:43,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000758653', 'lastCheck': '6.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611219', 'lastCheck': '6.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:13:43,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`27bf4161-b044-401a-876e-41414db20046`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000758653', 'lastCheck': '6.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611219', 'lastCheck': '6.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:13:43,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`27bf4161-b044-401a-876e-41414db20046`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:43,103::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:43,103::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:43,103::task::993::Storage.TaskManager.Task::(_decref) Task=`27bf4161-b044-401a-876e-41414db20046`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:13:43,125::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:13:43,835::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:13:43,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`3dde659a-9ca1-4e62-8b61-d2443c78fb78`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:43,836::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:13:43,848::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:43,849::task::1191::Storage.TaskManager.Task::(prepare) Task=`3dde659a-9ca1-4e62-8b61-d2443c78fb78`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:43,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`3dde659a-9ca1-4e62-8b61-d2443c78fb78`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:43,849::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:43,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:43,850::task::993::Storage.TaskManager.Task::(_decref) Task=`3dde659a-9ca1-4e62-8b61-d2443c78fb78`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:13:43,861::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:13:43,861::task::595::Storage.TaskManager.Task::(_updateState) Task=`66f51f3a-ef2f-41e2-ab3b-55c4068fe16f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:13:43,861::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:13:43,862::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9e651036-fc60-40e9-bc91-eced295d7eb3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:13:43,862::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:13:43,862::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:13:43,862::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9e651036-fc60-40e9-bc91-eced295d7eb3`::Granted request >Thread-32::DEBUG::2014-08-12 15:13:43,863::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`66f51f3a-ef2f-41e2-ab3b-55c4068fe16f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:13:43,863::task::993::Storage.TaskManager.Task::(_decref) Task=`66f51f3a-ef2f-41e2-ab3b-55c4068fe16f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:13:43,875::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:43,875::task::1191::Storage.TaskManager.Task::(prepare) Task=`66f51f3a-ef2f-41e2-ab3b-55c4068fe16f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:43,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`66f51f3a-ef2f-41e2-ab3b-55c4068fe16f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:13:43,876::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:13:43,876::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:13:43,876::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:13:43,876::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:13:43,876::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:13:43,877::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:13:43,877::task::993::Storage.TaskManager.Task::(_decref) Task=`66f51f3a-ef2f-41e2-ab3b-55c4068fe16f`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:13:44,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-16::DEBUG::2014-08-12 15:13:46,286::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:13:46,307::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00297731 s, 1.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:13:46,327::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:46,329::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:13:46,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:46,333::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:46,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:46,336::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:46,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:46,339::__init__::225::IOProcess::(_processLogs) (14412) Finding callback 'access'... >Dummy-31::DEBUG::2014-08-12 15:13:46,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.95028 s, 525 kB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:13:46,375::__init__::225::IOProcess::(_processLogs) (14412) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:46,376::__init__::225::IOProcess::(_processLogs) (14412) Building response >Thread-25::DEBUG::2014-08-12 15:13:46,377::__init__::225::IOProcess::(_processLogs) (14412) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:46,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:46,379::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:13:46,384::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:46,385::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:13:46,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:46,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:46,388::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:46,389::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:46,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:46,391::__init__::225::IOProcess::(_processLogs) (14413) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:46,393::__init__::225::IOProcess::(_processLogs) (14413) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:46,394::__init__::225::IOProcess::(_processLogs) (14413) Building response >Thread-25::DEBUG::2014-08-12 15:13:46,395::__init__::225::IOProcess::(_processLogs) (14413) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:46,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:46,397::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:13:46,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:13:46,590::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634725 s, 6.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:47,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:47,772::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:47,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:48,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:48,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013181 s, 77.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:50,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:50,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130562 s, 78.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:52,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:52,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131779 s, 77.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:52,789::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:52,790::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:52,800::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:13:53,892::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:13:53,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`557e246a-cebe-4b8f-962d-610a3e98a0e6`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:53,893::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:13:53,960::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:53,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`557e246a-cebe-4b8f-962d-610a3e98a0e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:13:53,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`557e246a-cebe-4b8f-962d-610a3e98a0e6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:53,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:53,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:53,961::task::993::Storage.TaskManager.Task::(_decref) Task=`557e246a-cebe-4b8f-962d-610a3e98a0e6`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:13:53,972::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:13:53,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9cfb75f-ef2e-4aeb-b892-22b79fdb6849`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:13:53,972::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:13:53,973::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`92f804ae-288f-4746-9b2b-3884662cdcf0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:13:53,973::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:13:53,973::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:13:53,974::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`92f804ae-288f-4746-9b2b-3884662cdcf0`::Granted request >Thread-32::DEBUG::2014-08-12 15:13:53,974::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d9cfb75f-ef2e-4aeb-b892-22b79fdb6849`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:13:53,975::task::993::Storage.TaskManager.Task::(_decref) Task=`d9cfb75f-ef2e-4aeb-b892-22b79fdb6849`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:13:53,987::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:53,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9cfb75f-ef2e-4aeb-b892-22b79fdb6849`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:13:53,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9cfb75f-ef2e-4aeb-b892-22b79fdb6849`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:13:53,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:13:53,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:13:53,988::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:13:53,988::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:13:53,988::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:13:53,989::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:13:53,989::task::993::Storage.TaskManager.Task::(_decref) Task=`d9cfb75f-ef2e-4aeb-b892-22b79fdb6849`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-12 15:13:54,326::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:13:54,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:54,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131718 s, 77.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:13:56,406::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:13:56,419::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641777 s, 6.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:13:56,422::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:56,422::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:13:56,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:56,422::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:56,422::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:56,423::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:56,423::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:56,423::__init__::225::IOProcess::(_processLogs) (14414) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:56,423::__init__::225::IOProcess::(_processLogs) (14414) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:56,423::__init__::225::IOProcess::(_processLogs) (14414) Building response >Thread-25::DEBUG::2014-08-12 15:13:56,423::__init__::225::IOProcess::(_processLogs) (14414) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:56,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:56,424::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:13:56,424::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:13:56,425::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:13:56,425::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:13:56,425::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:13:56,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:13:56,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:13:56,425::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:13:56,431::__init__::225::IOProcess::(_processLogs) (14415) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:13:56,432::__init__::225::IOProcess::(_processLogs) (14415) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:13:56,432::__init__::225::IOProcess::(_processLogs) (14415) Building response >Thread-25::DEBUG::2014-08-12 15:13:56,432::__init__::225::IOProcess::(_processLogs) (14415) Queuing response >Thread-25::DEBUG::2014-08-12 15:13:56,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:13:56,433::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:13:56,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:13:56,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000733046 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:13:56,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:56,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130645 s, 78.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:57,807::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:57,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:13:57,823::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:13:58,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb2ebb56-8754-4b63-913b-92ddc22b4dea`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:13:58,229::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:13:58,229::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641777', 'lastCheck': '1.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000733046', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:13:58,229::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb2ebb56-8754-4b63-913b-92ddc22b4dea`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641777', 'lastCheck': '1.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000733046', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:13:58,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb2ebb56-8754-4b63-913b-92ddc22b4dea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:13:58,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:13:58,230::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:13:58,230::task::993::Storage.TaskManager.Task::(_decref) Task=`eb2ebb56-8754-4b63-913b-92ddc22b4dea`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:13:58,254::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:13:58,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:13:58,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127637 s, 80.2 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:14:00,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`163e6c87-c2f2-462b-b64c-413908aaba98`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:14:00,068::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:14:00,069::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:14:00,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`163e6c87-c2f2-462b-b64c-413908aaba98`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:14:00,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`163e6c87-c2f2-462b-b64c-413908aaba98`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:14:00,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:14:00,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:14:00,069::task::993::Storage.TaskManager.Task::(_decref) Task=`163e6c87-c2f2-462b-b64c-413908aaba98`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:14:00,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`d67f4776-a6a7-49b1-87fb-c3cf61ea6a5a`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:14:00,070::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:14:00,070::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:14:00,070::task::1191::Storage.TaskManager.Task::(prepare) Task=`d67f4776-a6a7-49b1-87fb-c3cf61ea6a5a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:14:00,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`d67f4776-a6a7-49b1-87fb-c3cf61ea6a5a`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:14:00,071::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:14:00,071::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:14:00,071::task::993::Storage.TaskManager.Task::(_decref) Task=`d67f4776-a6a7-49b1-87fb-c3cf61ea6a5a`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:14:00,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf38c230-d8eb-417c-900b-3d2393ba7b7c`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:14:00,072::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:14:00,072::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:14:00,072::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf38c230-d8eb-417c-900b-3d2393ba7b7c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:14:00,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf38c230-d8eb-417c-900b-3d2393ba7b7c`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:14:00,072::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:14:00,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:14:00,073::task::993::Storage.TaskManager.Task::(_decref) Task=`cf38c230-d8eb-417c-900b-3d2393ba7b7c`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:14:00,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`056b6723-0d9f-4241-b42f-355e0def1a86`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:14:00,073::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:14:00,073::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:14:00,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`056b6723-0d9f-4241-b42f-355e0def1a86`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:14:00,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`056b6723-0d9f-4241-b42f-355e0def1a86`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:14:00,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:14:00,074::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:14:00,074::task::993::Storage.TaskManager.Task::(_decref) Task=`056b6723-0d9f-4241-b42f-355e0def1a86`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:14:00,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:01,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129683 s, 79.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:02,830::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:02,831::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:02,841::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:03,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:03,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134926 s, 75.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:14:04,005::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:14:04,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3663222-2731-496f-9c58-6810797857ba`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:04,006::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:14:04,039::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:04,039::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3663222-2731-496f-9c58-6810797857ba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:04,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3663222-2731-496f-9c58-6810797857ba`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:04,040::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:04,040::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:04,040::task::993::Storage.TaskManager.Task::(_decref) Task=`a3663222-2731-496f-9c58-6810797857ba`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:14:04,052::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:14:04,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fbc2856-8ef4-46da-b952-a827b4afa01e`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:14:04,052::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:14:04,053::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`bd5a2277-9036-4b88-be27-cd0a24e27b8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:14:04,053::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:14:04,054::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:14:04,054::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`bd5a2277-9036-4b88-be27-cd0a24e27b8a`::Granted request >Thread-32::DEBUG::2014-08-12 15:14:04,054::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2fbc2856-8ef4-46da-b952-a827b4afa01e`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:14:04,054::task::993::Storage.TaskManager.Task::(_decref) Task=`2fbc2856-8ef4-46da-b952-a827b4afa01e`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:14:04,067::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:04,067::task::1191::Storage.TaskManager.Task::(prepare) Task=`2fbc2856-8ef4-46da-b952-a827b4afa01e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:04,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fbc2856-8ef4-46da-b952-a827b4afa01e`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:14:04,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:14:04,067::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:14:04,068::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:14:04,068::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:14:04,068::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:14:04,068::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:14:04,068::task::993::Storage.TaskManager.Task::(_decref) Task=`2fbc2856-8ef4-46da-b952-a827b4afa01e`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:14:05,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:05,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130274 s, 78.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:06,435::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:14:06,446::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765658 s, 5.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:14:06,449::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:06,450::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:14:06,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:06,450::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:06,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:06,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:06,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:06,451::__init__::225::IOProcess::(_processLogs) (14416) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:06,451::__init__::225::IOProcess::(_processLogs) (14416) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:06,451::__init__::225::IOProcess::(_processLogs) DEBUG|(14416) Building response >Thread-25::DEBUG::2014-08-12 15:14:06,451::__init__::225::IOProcess::(_processLogs) (14416) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:06,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:06,451::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:14:06,452::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:06,452::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:14:06,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:06,453::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:06,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:06,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:06,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:06,453::__init__::225::IOProcess::(_processLogs) (14417) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:06,454::__init__::225::IOProcess::(_processLogs) (14417) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:06,454::__init__::225::IOProcess::(_processLogs) (14417) Building response >Thread-25::DEBUG::2014-08-12 15:14:06,454::__init__::225::IOProcess::(_processLogs) (14417) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:06,454::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:06,454::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:14:06,608::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:14:06,620::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669986 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:07,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:07,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122187 s, 83.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:07,847::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:07,848::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:07,870::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:09,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:09,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120975 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:11,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:11,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122672 s, 83.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:12,877::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:12,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:12,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:14:13,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e2e345e-0781-424a-b15a-8860f98c8335`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:13,348::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:14:13,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765658', 'lastCheck': '6.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669986', 'lastCheck': '6.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:14:13,348::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e2e345e-0781-424a-b15a-8860f98c8335`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765658', 'lastCheck': '6.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669986', 'lastCheck': '6.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:14:13,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e2e345e-0781-424a-b15a-8860f98c8335`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:13,349::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:13,349::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:13,349::task::993::Storage.TaskManager.Task::(_decref) Task=`9e2e345e-0781-424a-b15a-8860f98c8335`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:14:13,370::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:13,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:13,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120622 s, 84.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:14:14,085::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [175b0e4c] >Thread-14::DEBUG::2014-08-12 15:14:14,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa69e187-fb67-41a8-9c33-be9287226d4e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:14,086::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:14:14,099::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:14,099::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa69e187-fb67-41a8-9c33-be9287226d4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:14,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa69e187-fb67-41a8-9c33-be9287226d4e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:14,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:14,099::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:14,100::task::993::Storage.TaskManager.Task::(_decref) Task=`aa69e187-fb67-41a8-9c33-be9287226d4e`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:14:14,112::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [175b0e4c] >Thread-32::DEBUG::2014-08-12 15:14:14,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`81bc0814-cf1d-4725-9e41-dadddf702af5`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:14:14,113::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:14:14,113::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`50165f27-0127-430a-bae3-23292956b491`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:14:14,114::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:14:14,114::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:14:14,114::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`50165f27-0127-430a-bae3-23292956b491`::Granted request >Thread-32::DEBUG::2014-08-12 15:14:14,115::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`81bc0814-cf1d-4725-9e41-dadddf702af5`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:14:14,115::task::993::Storage.TaskManager.Task::(_decref) Task=`81bc0814-cf1d-4725-9e41-dadddf702af5`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:14:14,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:14,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`81bc0814-cf1d-4725-9e41-dadddf702af5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:14,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`81bc0814-cf1d-4725-9e41-dadddf702af5`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:14:14,128::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:14:14,128::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:14:14,128::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:14:14,128::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:14:14,129::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:14:14,129::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:14:14,129::task::993::Storage.TaskManager.Task::(_decref) Task=`81bc0814-cf1d-4725-9e41-dadddf702af5`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:14:15,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:15,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122363 s, 83.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:16,456::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:14:16,473::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000787779 s, 5.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:14:16,484::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:16,485::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:14:16,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:16,486::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:16,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:16,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:16,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:16,488::__init__::225::IOProcess::(_processLogs) (14418) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:16,488::__init__::225::IOProcess::(_processLogs) (14418) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:16,489::__init__::225::IOProcess::(_processLogs) (14418) Building response >Thread-25::DEBUG::2014-08-12 15:14:16,489::__init__::225::IOProcess::(_processLogs) (14418) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:16,490::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:16,490::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:14:16,493::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:16,493::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:14:16,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:16,494::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:16,495::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:16,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:16,496::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:16,496::__init__::225::IOProcess::(_processLogs) (14419) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:16,497::__init__::225::IOProcess::(_processLogs) (14419) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:16,497::__init__::225::IOProcess::(_processLogs) (14419) Building response >Thread-25::DEBUG::2014-08-12 15:14:16,498::__init__::225::IOProcess::(_processLogs) (14419) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:16,498::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:16,499::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:14:16,623::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:14:16,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718114 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:17,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:17,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123157 s, 83.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:17,895::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:17,896::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:17,905::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:19,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:19,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126015 s, 81.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:21,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:21,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124356 s, 82.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:22,912::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:22,913::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:22,923::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:23,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:23,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123615 s, 82.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:14:24,148::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:14:24,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`0302cc15-6fb9-48db-8fca-e5732bddace0`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:24,149::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:14:24,161::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:24,161::task::1191::Storage.TaskManager.Task::(prepare) Task=`0302cc15-6fb9-48db-8fca-e5732bddace0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:24,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`0302cc15-6fb9-48db-8fca-e5732bddace0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:24,161::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:24,162::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:24,162::task::993::Storage.TaskManager.Task::(_decref) Task=`0302cc15-6fb9-48db-8fca-e5732bddace0`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:14:24,173::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:14:24,173::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3f5b744-1606-4162-8868-138b74244d56`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:14:24,174::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:14:24,174::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a69bfbe9-0887-4859-b2ef-ca569c3d338c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:14:24,174::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:14:24,175::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:14:24,175::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a69bfbe9-0887-4859-b2ef-ca569c3d338c`::Granted request >Thread-32::DEBUG::2014-08-12 15:14:24,175::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a3f5b744-1606-4162-8868-138b74244d56`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:14:24,175::task::993::Storage.TaskManager.Task::(_decref) Task=`a3f5b744-1606-4162-8868-138b74244d56`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:14:24,188::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:24,188::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3f5b744-1606-4162-8868-138b74244d56`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:24,188::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3f5b744-1606-4162-8868-138b74244d56`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:14:24,188::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:14:24,188::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:14:24,189::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:14:24,189::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:14:24,189::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:14:24,189::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:14:24,189::task::993::Storage.TaskManager.Task::(_decref) Task=`a3f5b744-1606-4162-8868-138b74244d56`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-12 15:14:24,383::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:14:25,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:25,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121253 s, 84.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:26,501::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:14:26,515::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622899 s, 6.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:14:26,518::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:26,518::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:14:26,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:26,519::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:26,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:26,519::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:26,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:26,520::__init__::225::IOProcess::(_processLogs) (14420) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:26,520::__init__::225::IOProcess::(_processLogs) (14420) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:26,520::__init__::225::IOProcess::(_processLogs) (14420) Building response >Thread-25::DEBUG::2014-08-12 15:14:26,521::__init__::225::IOProcess::(_processLogs) (14420) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:26,521::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:26,521::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:14:26,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:26,522::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:14:26,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:26,522::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:26,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:26,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:26,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:26,523::__init__::225::IOProcess::(_processLogs) (14421) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:26,523::__init__::225::IOProcess::(_processLogs) (14421) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:26,523::__init__::225::IOProcess::(_processLogs) (14421) Building response >Thread-25::DEBUG::2014-08-12 15:14:26,523::__init__::225::IOProcess::(_processLogs) (14421) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:26,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:26,524::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-33::DEBUG::2014-08-12 15:14:26,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:14:26,651::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669779 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:27,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:27,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122084 s, 83.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:27,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:27,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:27,971::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:14:28,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d89f6cd-4de1-47fa-9c5a-9b9e31c51aff`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:28,467::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:14:28,467::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622899', 'lastCheck': '1.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669779', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:14:28,467::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d89f6cd-4de1-47fa-9c5a-9b9e31c51aff`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622899', 'lastCheck': '1.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669779', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:14:28,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d89f6cd-4de1-47fa-9c5a-9b9e31c51aff`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:28,468::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:28,468::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:28,468::task::993::Storage.TaskManager.Task::(_decref) Task=`9d89f6cd-4de1-47fa-9c5a-9b9e31c51aff`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:14:28,499::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:29,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:30,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121931 s, 84.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:32,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:32,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012029 s, 85.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:32,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:32,979::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:32,988::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:34,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:34,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122109 s, 83.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:14:34,210::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [66f05af2] >Thread-14::DEBUG::2014-08-12 15:14:34,211::task::595::Storage.TaskManager.Task::(_updateState) Task=`beab7b18-7532-49d4-98eb-b827e540b8f1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:34,211::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:14:34,304::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:34,304::task::1191::Storage.TaskManager.Task::(prepare) Task=`beab7b18-7532-49d4-98eb-b827e540b8f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:34,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`beab7b18-7532-49d4-98eb-b827e540b8f1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:34,305::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:34,305::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:34,305::task::993::Storage.TaskManager.Task::(_decref) Task=`beab7b18-7532-49d4-98eb-b827e540b8f1`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:14:34,317::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [66f05af2] >Thread-32::DEBUG::2014-08-12 15:14:34,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa12a1fa-4972-41eb-adea-2e84e8d6b093`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:14:34,318::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:14:34,318::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2559606c-ffe8-41b0-b23f-e462b998f042`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:14:34,318::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:14:34,319::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:14:34,319::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2559606c-ffe8-41b0-b23f-e462b998f042`::Granted request >Thread-32::DEBUG::2014-08-12 15:14:34,319::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fa12a1fa-4972-41eb-adea-2e84e8d6b093`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:14:34,319::task::993::Storage.TaskManager.Task::(_decref) Task=`fa12a1fa-4972-41eb-adea-2e84e8d6b093`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:14:34,332::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:34,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa12a1fa-4972-41eb-adea-2e84e8d6b093`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:34,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa12a1fa-4972-41eb-adea-2e84e8d6b093`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:14:34,332::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:14:34,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:14:34,333::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:14:34,333::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:14:34,333::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:14:34,333::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:14:34,334::task::993::Storage.TaskManager.Task::(_decref) Task=`fa12a1fa-4972-41eb-adea-2e84e8d6b093`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:14:36,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:36,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123429 s, 83.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:36,525::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::DEBUG::2014-08-12 15:14:36,525::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:14:36,526::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:14:36,537::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000647688 s, 3.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:36,537::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000647688 s, 3.2 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:14:36,538::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:14:36,538::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:14:36,538::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:14:36,538::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:14:36,539::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:14:36,539::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:14:36,539::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:14:36,539::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:14:36,540::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-33::DEBUG::2014-08-12 15:14:36,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:14:36,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066904 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:36,877::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:36,878::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:14:36,878::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::INFO::2014-08-12 15:14:36,879::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::INFO::2014-08-12 15:14:36,879::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::INFO::2014-08-12 15:14:36,879::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:14:36,880::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:14:37,058::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:37,059::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:14:37,070::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000565461 s, 7.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:14:37,073::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:37,073::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:14:37,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:37,074::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:37,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:37,074::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:37,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:37,074::__init__::225::IOProcess::(_processLogs) (14422) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:37,074::__init__::225::IOProcess::(_processLogs) (14422) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:37,075::__init__::225::IOProcess::(_processLogs) (14422) Building response >Thread-25::DEBUG::2014-08-12 15:14:37,075::__init__::225::IOProcess::(_processLogs) (14422) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:37,075::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:37,075::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:14:37,076::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:37,076::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:14:37,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:37,077::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:37,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:37,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:37,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:37,077::__init__::225::IOProcess::(_processLogs) (14423) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:37,078::__init__::225::IOProcess::(_processLogs) (14423) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:37,078::__init__::225::IOProcess::(_processLogs) (14423) Building response >Thread-25::DEBUG::2014-08-12 15:14:37,078::__init__::225::IOProcess::(_processLogs) (14423) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:37,078::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:37,079::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:37,994::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:37,995::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:38,012::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:38,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:38,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125218 s, 81.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:40,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:40,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122434 s, 83.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:42,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:42,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120718 s, 84.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:43,018::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:43,019::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:43,029::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:14:43,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8647966-2742-4041-bb2b-db92fc9a3c18`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:43,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:14:43,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565461', 'lastCheck': '6.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066904', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:14:43,631::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8647966-2742-4041-bb2b-db92fc9a3c18`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565461', 'lastCheck': '6.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066904', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:14:43,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8647966-2742-4041-bb2b-db92fc9a3c18`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:43,631::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:43,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:43,632::task::993::Storage.TaskManager.Task::(_decref) Task=`f8647966-2742-4041-bb2b-db92fc9a3c18`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:14:43,662::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:14:44,349::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:14:44,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`78cd7eb5-958b-438a-b1e0-d9ec975e70b1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:44,350::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:14:44,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:44,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`78cd7eb5-958b-438a-b1e0-d9ec975e70b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:44,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`78cd7eb5-958b-438a-b1e0-d9ec975e70b1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:44,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:44,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:44,363::task::993::Storage.TaskManager.Task::(_decref) Task=`78cd7eb5-958b-438a-b1e0-d9ec975e70b1`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:14:44,373::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:14:44,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`b882302f-7426-4dba-8e29-e1d83c975127`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:14:44,374::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:14:44,374::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f2bbb3a3-4d10-43ac-b3cf-7233f3a66df7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:14:44,375::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:14:44,375::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:14:44,375::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f2bbb3a3-4d10-43ac-b3cf-7233f3a66df7`::Granted request >Thread-32::DEBUG::2014-08-12 15:14:44,375::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b882302f-7426-4dba-8e29-e1d83c975127`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:14:44,376::task::993::Storage.TaskManager.Task::(_decref) Task=`b882302f-7426-4dba-8e29-e1d83c975127`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:14:44,392::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:44,392::task::1191::Storage.TaskManager.Task::(prepare) Task=`b882302f-7426-4dba-8e29-e1d83c975127`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:44,392::task::595::Storage.TaskManager.Task::(_updateState) Task=`b882302f-7426-4dba-8e29-e1d83c975127`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:14:44,393::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:14:44,393::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:14:44,393::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:14:44,393::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:14:44,393::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:14:44,393::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:14:44,394::task::993::Storage.TaskManager.Task::(_decref) Task=`b882302f-7426-4dba-8e29-e1d83c975127`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:14:44,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:44,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121243 s, 84.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:46,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:46,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0189195 s, 54.1 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:14:46,667::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:14:46,680::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637827 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:47,080::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:14:47,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057213 s, 7.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:14:47,099::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:47,100::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:14:47,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:47,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:47,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:47,100::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:47,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:47,101::__init__::225::IOProcess::(_processLogs) (14424) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:47,101::__init__::225::IOProcess::(_processLogs) (14424) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:47,101::__init__::225::IOProcess::(_processLogs) (14424) Building response >Thread-25::DEBUG::2014-08-12 15:14:47,101::__init__::225::IOProcess::(_processLogs) (14424) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:47,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:47,102::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:14:47,102::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:47,102::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:14:47,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:47,103::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:47,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:47,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:47,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:47,103::__init__::225::IOProcess::(_processLogs) (14425) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:47,104::__init__::225::IOProcess::(_processLogs) (14425) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:47,104::__init__::225::IOProcess::(_processLogs) (14425) Building response >Thread-25::DEBUG::2014-08-12 15:14:47,104::__init__::225::IOProcess::(_processLogs) (14425) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:47,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:47,104::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:48,036::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:48,037::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:48,047::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:48,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:48,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124635 s, 82.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:50,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:50,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121545 s, 84.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:52,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:52,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193478 s, 52.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:53,053::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:53,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:53,058::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:14:54,411::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:14:54,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`d10c4a41-37fd-49bd-8bfc-587894c8ee7c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:54,412::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >VM Channels Listener::DEBUG::2014-08-12 15:14:54,420::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::INFO::2014-08-12 15:14:54,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:54,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`d10c4a41-37fd-49bd-8bfc-587894c8ee7c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:14:54,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`d10c4a41-37fd-49bd-8bfc-587894c8ee7c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:54,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:54,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:54,448::task::993::Storage.TaskManager.Task::(_decref) Task=`d10c4a41-37fd-49bd-8bfc-587894c8ee7c`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:14:54,464::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:14:54,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc546d11-a028-40a7-b3a9-921ecc4ab771`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:14:54,464::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:14:54,465::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`b4c97cd3-d72b-4a07-b6ff-ca3aa44a9c95`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:14:54,465::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:14:54,465::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:14:54,465::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`b4c97cd3-d72b-4a07-b6ff-ca3aa44a9c95`::Granted request >Thread-32::DEBUG::2014-08-12 15:14:54,466::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bc546d11-a028-40a7-b3a9-921ecc4ab771`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:14:54,466::task::993::Storage.TaskManager.Task::(_decref) Task=`bc546d11-a028-40a7-b3a9-921ecc4ab771`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:14:54,478::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:54,479::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc546d11-a028-40a7-b3a9-921ecc4ab771`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:14:54,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc546d11-a028-40a7-b3a9-921ecc4ab771`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:14:54,479::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:14:54,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:14:54,479::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:14:54,480::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:14:54,480::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:14:54,480::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:14:54,480::task::993::Storage.TaskManager.Task::(_decref) Task=`bc546d11-a028-40a7-b3a9-921ecc4ab771`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:14:54,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:54,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130459 s, 78.5 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:14:56,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:14:56,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774206 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:14:57,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:57,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129801 s, 78.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:14:57,106::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:14:57,118::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706884 s, 5.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:14:57,121::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:57,122::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:14:57,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:57,122::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:57,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:57,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:57,123::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:57,123::__init__::225::IOProcess::(_processLogs) (14426) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:57,123::__init__::225::IOProcess::(_processLogs) (14426) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:57,123::__init__::225::IOProcess::(_processLogs) (14426) Building response >Thread-25::DEBUG::2014-08-12 15:14:57,123::__init__::225::IOProcess::(_processLogs) (14426) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:57,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:57,123::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:14:57,124::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:14:57,125::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:14:57,125::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:14:57,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:14:57,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:14:57,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:14:57,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:14:57,126::__init__::225::IOProcess::(_processLogs) (14427) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:14:57,126::__init__::225::IOProcess::(_processLogs) (14427) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:14:57,126::__init__::225::IOProcess::(_processLogs) (14427) Building response >Thread-25::DEBUG::2014-08-12 15:14:57,126::__init__::225::IOProcess::(_processLogs) (14427) Queuing response >Thread-25::DEBUG::2014-08-12 15:14:57,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:14:57,126::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:58,065::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:58,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:14:58,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:14:58,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9f5a653-e5a0-4b01-9458-8146b9a591a8`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:14:58,779::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:14:58,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706884', 'lastCheck': '1.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774206', 'lastCheck': '2.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:14:58,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9f5a653-e5a0-4b01-9458-8146b9a591a8`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706884', 'lastCheck': '1.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774206', 'lastCheck': '2.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:14:58,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9f5a653-e5a0-4b01-9458-8146b9a591a8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:14:58,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:14:58,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:14:58,780::task::993::Storage.TaskManager.Task::(_decref) Task=`a9f5a653-e5a0-4b01-9458-8146b9a591a8`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:14:58,803::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:14:59,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:14:59,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129104 s, 79.3 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:15:00,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaed7cac-3c8a-4b54-b9da-5205fc8a21ae`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:15:00,978::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:15:00,979::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:15:00,979::task::1191::Storage.TaskManager.Task::(prepare) Task=`eaed7cac-3c8a-4b54-b9da-5205fc8a21ae`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:15:00,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaed7cac-3c8a-4b54-b9da-5205fc8a21ae`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:15:00,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:15:00,979::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:15:00,980::task::993::Storage.TaskManager.Task::(_decref) Task=`eaed7cac-3c8a-4b54-b9da-5205fc8a21ae`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:15:00,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`53c752d9-9bbd-4729-aff7-ebb76cda3908`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:15:00,980::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:15:00,980::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:15:00,981::task::1191::Storage.TaskManager.Task::(prepare) Task=`53c752d9-9bbd-4729-aff7-ebb76cda3908`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:15:00,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`53c752d9-9bbd-4729-aff7-ebb76cda3908`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:15:00,981::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:15:00,981::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:15:00,981::task::993::Storage.TaskManager.Task::(_decref) Task=`53c752d9-9bbd-4729-aff7-ebb76cda3908`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:15:00,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`402e818d-7e02-44da-af33-b83303a02cb2`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:15:00,982::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:15:00,982::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:15:00,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`402e818d-7e02-44da-af33-b83303a02cb2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:15:00,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`402e818d-7e02-44da-af33-b83303a02cb2`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:15:00,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:15:00,982::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:15:00,983::task::993::Storage.TaskManager.Task::(_decref) Task=`402e818d-7e02-44da-af33-b83303a02cb2`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:15:00,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ea540a1-c07d-44d1-9301-2a4e97416a81`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:15:00,983::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:15:00,983::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:15:00,984::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ea540a1-c07d-44d1-9301-2a4e97416a81`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:15:00,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ea540a1-c07d-44d1-9301-2a4e97416a81`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:15:00,984::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:15:00,984::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:15:00,984::task::993::Storage.TaskManager.Task::(_decref) Task=`0ea540a1-c07d-44d1-9301-2a4e97416a81`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:15:01,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:01,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133355 s, 76.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:03,094::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:03,099::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:03,100::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:03,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:03,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131216 s, 78.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:15:04,499::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:15:04,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9098411-8245-4326-863b-3567b2575702`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:04,500::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:15:04,512::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:04,512::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9098411-8245-4326-863b-3567b2575702`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:04,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9098411-8245-4326-863b-3567b2575702`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:04,512::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:04,512::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:04,513::task::993::Storage.TaskManager.Task::(_decref) Task=`a9098411-8245-4326-863b-3567b2575702`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:15:04,529::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:15:04,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`aecfd73a-f6f1-4de3-b29c-3700f7596952`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:15:04,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:15:04,530::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d4892272-8826-41b7-a817-64c997ff9eb0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:15:04,530::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:15:04,530::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:15:04,530::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`d4892272-8826-41b7-a817-64c997ff9eb0`::Granted request >Thread-32::DEBUG::2014-08-12 15:15:04,531::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aecfd73a-f6f1-4de3-b29c-3700f7596952`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:15:04,531::task::993::Storage.TaskManager.Task::(_decref) Task=`aecfd73a-f6f1-4de3-b29c-3700f7596952`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:15:04,543::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:04,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`aecfd73a-f6f1-4de3-b29c-3700f7596952`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:04,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`aecfd73a-f6f1-4de3-b29c-3700f7596952`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:15:04,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:15:04,544::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:15:04,544::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:15:04,545::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:15:04,545::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:15:04,545::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:15:04,545::task::993::Storage.TaskManager.Task::(_decref) Task=`aecfd73a-f6f1-4de3-b29c-3700f7596952`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:15:05,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:05,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134229 s, 76.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:06,697::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:06,709::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814283 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:15:07,128::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:15:07,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728754 s, 5.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:15:07,143::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:07,143::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:15:07,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:07,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:07,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:07,144::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:07,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:07,144::__init__::225::IOProcess::(_processLogs) (14428) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:07,144::__init__::225::IOProcess::(_processLogs) (14428) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:07,144::__init__::225::IOProcess::(_processLogs) (14428) Building response >Thread-25::DEBUG::2014-08-12 15:15:07,145::__init__::225::IOProcess::(_processLogs) (14428) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:07,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:07,145::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:15:07,146::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:07,146::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:15:07,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:07,146::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:07,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:07,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:07,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:07,147::__init__::225::IOProcess::(_processLogs) (14429) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:07,147::__init__::225::IOProcess::(_processLogs) (14429) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:07,147::__init__::225::IOProcess::(_processLogs) (14429) Building response >Thread-25::DEBUG::2014-08-12 15:15:07,147::__init__::225::IOProcess::(_processLogs) (14429) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:07,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:07,148::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:15:07,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:07,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135571 s, 75.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:08,107::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:08,108::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:08,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:09,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:09,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128355 s, 79.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:15:11,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:11,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130016 s, 78.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:13,135::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:13,136::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:13,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:13,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:13,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130527 s, 78.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:15:13,902::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d59e7b4-7f3c-4ec0-9a60-e9fe5386bd1c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:13,902::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:15:13,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728754', 'lastCheck': '6.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814283', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:15:13,903::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d59e7b4-7f3c-4ec0-9a60-e9fe5386bd1c`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728754', 'lastCheck': '6.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814283', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:15:13,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d59e7b4-7f3c-4ec0-9a60-e9fe5386bd1c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:13,903::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:13,903::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:13,903::task::993::Storage.TaskManager.Task::(_decref) Task=`8d59e7b4-7f3c-4ec0-9a60-e9fe5386bd1c`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:15:13,944::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:15:14,575::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:15:14,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`e75389bb-968d-46c7-945d-71154dc8f538`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:14,575::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:15:14,630::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:14,630::task::1191::Storage.TaskManager.Task::(prepare) Task=`e75389bb-968d-46c7-945d-71154dc8f538`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:14,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`e75389bb-968d-46c7-945d-71154dc8f538`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:14,630::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:14,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:14,631::task::993::Storage.TaskManager.Task::(_decref) Task=`e75389bb-968d-46c7-945d-71154dc8f538`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:15:14,647::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:15:14,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`e88d413c-9618-4ed3-b695-c7b6ff6e0b0e`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:15:14,647::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:15:14,648::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`eaf54ab0-d87d-42d0-bac1-0d72d5d8ff76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:15:14,648::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:15:14,648::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:15:14,649::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`eaf54ab0-d87d-42d0-bac1-0d72d5d8ff76`::Granted request >Thread-32::DEBUG::2014-08-12 15:15:14,649::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e88d413c-9618-4ed3-b695-c7b6ff6e0b0e`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:15:14,649::task::993::Storage.TaskManager.Task::(_decref) Task=`e88d413c-9618-4ed3-b695-c7b6ff6e0b0e`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:15:14,661::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:14,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`e88d413c-9618-4ed3-b695-c7b6ff6e0b0e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:14,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`e88d413c-9618-4ed3-b695-c7b6ff6e0b0e`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:15:14,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:15:14,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:15:14,662::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:15:14,663::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:15:14,663::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:15:14,663::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:15:14,663::task::993::Storage.TaskManager.Task::(_decref) Task=`e88d413c-9618-4ed3-b695-c7b6ff6e0b0e`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:15:15,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:15,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0156042 s, 65.6 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:16,711::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:16,723::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729587 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:15:17,149::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:15:17,160::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759979 s, 5.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:15:17,164::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:17,164::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:15:17,164::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:17,164::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:17,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:17,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:17,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:17,165::__init__::225::IOProcess::(_processLogs) (14430) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:17,166::__init__::225::IOProcess::(_processLogs) (14430) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:17,166::__init__::225::IOProcess::(_processLogs) (14430) Building response >Thread-25::DEBUG::2014-08-12 15:15:17,166::__init__::225::IOProcess::(_processLogs) (14430) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:17,166::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:17,166::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:15:17,167::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:17,167::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:15:17,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:17,168::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:17,168::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:17,168::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:17,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:17,168::__init__::225::IOProcess::(_processLogs) (14431) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:17,168::__init__::225::IOProcess::(_processLogs) (14431) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:17,168::__init__::225::IOProcess::(_processLogs) (14431) Building response >Thread-25::DEBUG::2014-08-12 15:15:17,169::__init__::225::IOProcess::(_processLogs) (14431) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:17,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:17,169::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:15:17,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:17,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122012 s, 83.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:18,153::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:18,154::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:18,164::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:19,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:19,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012323 s, 83.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:15:21,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:21,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123865 s, 82.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:23,168::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:23,169::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:23,181::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:23,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:24,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012168 s, 84.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:15:24,458::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::DEBUG::2014-08-12 15:15:24,686::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:15:24,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad79eb6d-fd71-431a-b39c-55014c5cc169`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:24,687::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:15:24,717::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:24,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad79eb6d-fd71-431a-b39c-55014c5cc169`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:24,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad79eb6d-fd71-431a-b39c-55014c5cc169`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:24,717::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:24,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:24,717::task::993::Storage.TaskManager.Task::(_decref) Task=`ad79eb6d-fd71-431a-b39c-55014c5cc169`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:15:24,728::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:15:24,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`fec0bf0d-0978-47a8-a2b2-7b595fe0e6ec`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:15:24,729::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:15:24,730::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`704d2801-2c59-4fad-a7bb-54f82d1497d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:15:24,730::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:15:24,730::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:15:24,730::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`704d2801-2c59-4fad-a7bb-54f82d1497d2`::Granted request >Thread-32::DEBUG::2014-08-12 15:15:24,731::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fec0bf0d-0978-47a8-a2b2-7b595fe0e6ec`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:15:24,731::task::993::Storage.TaskManager.Task::(_decref) Task=`fec0bf0d-0978-47a8-a2b2-7b595fe0e6ec`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:15:24,743::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:24,743::task::1191::Storage.TaskManager.Task::(prepare) Task=`fec0bf0d-0978-47a8-a2b2-7b595fe0e6ec`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:24,744::task::595::Storage.TaskManager.Task::(_updateState) Task=`fec0bf0d-0978-47a8-a2b2-7b595fe0e6ec`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:15:24,744::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:15:24,744::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:15:24,744::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:15:24,744::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:15:24,745::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:15:24,745::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:15:24,745::task::993::Storage.TaskManager.Task::(_decref) Task=`fec0bf0d-0978-47a8-a2b2-7b595fe0e6ec`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:15:26,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:26,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155242 s, 66.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:26,726::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-33::DEBUG::2014-08-12 15:15:26,726::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:15:26,727::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:26,738::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000675266 s, 3.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:26,738::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000675266 s, 3.0 MB/s'], size: 2048 >Thread-33::DEBUG::2014-08-12 15:15:26,739::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-33::DEBUG::2014-08-12 15:15:26,739::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-33::DEBUG::2014-08-12 15:15:26,739::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:15:26,739::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:15:26,740::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:15:26,740::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:15:26,740::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:15:26,740::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:15:26,741::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:26,987::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:26,987::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:15:26,988::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-33::INFO::2014-08-12 15:15:26,989::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-33::INFO::2014-08-12 15:15:26,989::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-33::INFO::2014-08-12 15:15:26,989::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-33::DEBUG::2014-08-12 15:15:26,989::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:27,162::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:27,162::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:27,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564574 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:15:27,176::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:15:27,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000527408 s, 7.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:15:27,193::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:27,193::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:15:27,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:27,193::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:27,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:27,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:27,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:27,194::__init__::225::IOProcess::(_processLogs) (14432) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:27,194::__init__::225::IOProcess::(_processLogs) (14432) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:27,194::__init__::225::IOProcess::(_processLogs) (14432) Building response >Thread-25::DEBUG::2014-08-12 15:15:27,194::__init__::225::IOProcess::(_processLogs) (14432) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:27,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:27,195::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:15:27,195::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:27,196::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:15:27,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:27,196::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:27,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:27,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:27,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:27,197::__init__::225::IOProcess::(_processLogs) (14433) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:27,197::__init__::225::IOProcess::(_processLogs) (14433) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:27,197::__init__::225::IOProcess::(_processLogs) (14433) Building response >Thread-25::DEBUG::2014-08-12 15:15:27,197::__init__::225::IOProcess::(_processLogs) (14433) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:27,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:27,197::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:15:28,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:28,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126901 s, 80.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:28,188::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:28,189::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:28,205::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:15:29,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cf8a16f-39a3-4313-aff0-d3bb059b525b`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:29,037::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:15:29,038::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527408', 'lastCheck': '1.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564574', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:15:29,038::task::1191::Storage.TaskManager.Task::(prepare) Task=`3cf8a16f-39a3-4313-aff0-d3bb059b525b`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527408', 'lastCheck': '1.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564574', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:15:29,038::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cf8a16f-39a3-4313-aff0-d3bb059b525b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:29,038::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:29,038::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:29,038::task::993::Storage.TaskManager.Task::(_decref) Task=`3cf8a16f-39a3-4313-aff0-d3bb059b525b`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:15:29,074::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:30,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:30,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122296 s, 83.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:15:32,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:32,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122382 s, 83.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:33,212::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:33,213::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:33,223::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:34,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:34,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119852 s, 85.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:15:34,761::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:15:34,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`841013b8-5e2c-4b3c-aaca-ecde06cb59c1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:34,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:15:34,818::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:34,819::task::1191::Storage.TaskManager.Task::(prepare) Task=`841013b8-5e2c-4b3c-aaca-ecde06cb59c1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:34,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`841013b8-5e2c-4b3c-aaca-ecde06cb59c1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:34,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:34,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:34,819::task::993::Storage.TaskManager.Task::(_decref) Task=`841013b8-5e2c-4b3c-aaca-ecde06cb59c1`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:15:34,831::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:15:34,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7e3c544-4ad9-4aac-837e-dedd585e7e66`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:15:34,832::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:15:34,832::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`44888ae7-472e-4994-a8a6-31e4283d7970`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:15:34,832::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:15:34,833::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:15:34,833::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`44888ae7-472e-4994-a8a6-31e4283d7970`::Granted request >Thread-32::DEBUG::2014-08-12 15:15:34,833::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e7e3c544-4ad9-4aac-837e-dedd585e7e66`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:15:34,833::task::993::Storage.TaskManager.Task::(_decref) Task=`e7e3c544-4ad9-4aac-837e-dedd585e7e66`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:15:34,846::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:34,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7e3c544-4ad9-4aac-837e-dedd585e7e66`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:34,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7e3c544-4ad9-4aac-837e-dedd585e7e66`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:15:34,846::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:15:34,846::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:15:34,847::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:15:34,847::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:15:34,847::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:15:34,847::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:15:34,847::task::993::Storage.TaskManager.Task::(_decref) Task=`e7e3c544-4ad9-4aac-837e-dedd585e7e66`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:15:36,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:36,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123402 s, 83.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:37,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:37,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714939 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:15:37,203::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:15:37,216::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619026 s, 6.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:15:37,219::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:37,219::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:15:37,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:37,220::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:37,220::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:37,220::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:37,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:37,220::__init__::225::IOProcess::(_processLogs) (14434) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:37,220::__init__::225::IOProcess::(_processLogs) (14434) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:37,221::__init__::225::IOProcess::(_processLogs) (14434) Building response >Thread-25::DEBUG::2014-08-12 15:15:37,221::__init__::225::IOProcess::(_processLogs) (14434) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:37,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:37,221::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:15:37,222::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:37,222::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:15:37,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:37,222::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:37,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:37,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:37,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:37,223::__init__::225::IOProcess::(_processLogs) (14435) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:37,223::__init__::225::IOProcess::(_processLogs) (14435) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:37,223::__init__::225::IOProcess::(_processLogs) (14435) Building response >Thread-25::DEBUG::2014-08-12 15:15:37,223::__init__::225::IOProcess::(_processLogs) (14435) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:37,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:37,224::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:38,229::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:38,230::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:38,240::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:38,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:38,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127391 s, 80.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:15:40,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:40,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211896 s, 48.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:15:42,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:42,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128334 s, 79.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:43,247::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:43,248::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:43,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:15:44,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ebf5983-93a9-4a55-b403-3f94a8098417`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:44,187::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:15:44,187::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619026', 'lastCheck': '7.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714939', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:15:44,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ebf5983-93a9-4a55-b403-3f94a8098417`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619026', 'lastCheck': '7.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714939', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:15:44,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ebf5983-93a9-4a55-b403-3f94a8098417`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:44,187::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:44,188::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:44,188::task::993::Storage.TaskManager.Task::(_decref) Task=`8ebf5983-93a9-4a55-b403-3f94a8098417`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:15:44,212::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:44,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:44,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012178 s, 84.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:15:44,864::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [42db2bf0] >Thread-14::DEBUG::2014-08-12 15:15:44,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4df57f8-85a8-451f-8164-a4ed369a7304`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:44,865::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:15:44,901::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:44,901::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4df57f8-85a8-451f-8164-a4ed369a7304`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:44,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4df57f8-85a8-451f-8164-a4ed369a7304`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:44,901::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:44,902::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:44,902::task::993::Storage.TaskManager.Task::(_decref) Task=`e4df57f8-85a8-451f-8164-a4ed369a7304`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:15:44,913::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [42db2bf0] >Thread-32::DEBUG::2014-08-12 15:15:44,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`75656e4c-3538-4893-8d3c-60b19effc176`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:15:44,913::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:15:44,914::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`814638d8-c674-4090-b844-da789ea2c50e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:15:44,914::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:15:44,914::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:15:44,914::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`814638d8-c674-4090-b844-da789ea2c50e`::Granted request >Thread-32::DEBUG::2014-08-12 15:15:44,915::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`75656e4c-3538-4893-8d3c-60b19effc176`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:15:44,915::task::993::Storage.TaskManager.Task::(_decref) Task=`75656e4c-3538-4893-8d3c-60b19effc176`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:15:44,932::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:44,932::task::1191::Storage.TaskManager.Task::(prepare) Task=`75656e4c-3538-4893-8d3c-60b19effc176`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:44,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`75656e4c-3538-4893-8d3c-60b19effc176`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:15:44,933::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:15:44,933::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:15:44,933::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:15:44,933::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:15:44,933::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:15:44,934::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:15:44,934::task::993::Storage.TaskManager.Task::(_decref) Task=`75656e4c-3538-4893-8d3c-60b19effc176`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:15:46,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:46,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0197159 s, 51.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:47,216::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:47,229::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00052626 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:15:47,229::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:15:47,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000458294 s, 8.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:15:47,246::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:47,246::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:15:47,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:47,246::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:47,247::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:47,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:47,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:47,247::__init__::225::IOProcess::(_processLogs) (14436) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:47,247::__init__::225::IOProcess::(_processLogs) (14436) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:47,247::__init__::225::IOProcess::(_processLogs) (14436) Building response >Thread-25::DEBUG::2014-08-12 15:15:47,247::__init__::225::IOProcess::(_processLogs) (14436) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:47,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:47,248::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:15:47,249::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:47,249::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:15:47,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:47,249::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:47,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:47,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:47,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:47,250::__init__::225::IOProcess::(_processLogs) (14437) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:47,250::__init__::225::IOProcess::(_processLogs) (14437) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:47,250::__init__::225::IOProcess::(_processLogs) (14437) Building response >Thread-25::DEBUG::2014-08-12 15:15:47,250::__init__::225::IOProcess::(_processLogs) (14437) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:47,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:47,251::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:48,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:48,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:48,269::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:48,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:48,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122776 s, 83.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:15:50,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:50,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121891 s, 84.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:15:53,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:53,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171871 s, 59.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:53,276::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:53,277::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:53,289::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:15:54,495::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::DEBUG::2014-08-12 15:15:54,948::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:15:54,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab9ddfa9-37df-4656-8de6-9b4daf324cd3`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:54,951::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:15:54,963::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:54,963::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab9ddfa9-37df-4656-8de6-9b4daf324cd3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:15:54,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab9ddfa9-37df-4656-8de6-9b4daf324cd3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:54,963::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:54,964::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:54,964::task::993::Storage.TaskManager.Task::(_decref) Task=`ab9ddfa9-37df-4656-8de6-9b4daf324cd3`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:15:54,975::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:15:54,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`726575d0-5a5d-4f6d-a8d7-bd6c2f82aeb2`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:15:54,976::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:15:54,976::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`156efc1c-c053-4c36-9147-ed0ddb39a304`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:15:54,976::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:15:54,976::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:15:54,977::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`156efc1c-c053-4c36-9147-ed0ddb39a304`::Granted request >Thread-32::DEBUG::2014-08-12 15:15:54,977::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`726575d0-5a5d-4f6d-a8d7-bd6c2f82aeb2`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:15:54,977::task::993::Storage.TaskManager.Task::(_decref) Task=`726575d0-5a5d-4f6d-a8d7-bd6c2f82aeb2`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:15:54,990::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:54,990::task::1191::Storage.TaskManager.Task::(prepare) Task=`726575d0-5a5d-4f6d-a8d7-bd6c2f82aeb2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:15:54,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`726575d0-5a5d-4f6d-a8d7-bd6c2f82aeb2`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:15:54,990::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:15:54,990::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:15:54,991::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:15:54,991::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:15:54,991::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:15:54,991::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:15:54,991::task::993::Storage.TaskManager.Task::(_decref) Task=`726575d0-5a5d-4f6d-a8d7-bd6c2f82aeb2`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:15:55,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:55,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124819 s, 82.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:15:57,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:57,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122114 s, 83.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:15:57,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:15:57,257::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595013 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:15:57,258::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:15:57,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000538026 s, 7.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:15:57,275::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:57,275::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:15:57,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:57,275::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:57,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:57,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:57,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:57,276::__init__::225::IOProcess::(_processLogs) (14438) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:57,276::__init__::225::IOProcess::(_processLogs) (14438) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:57,276::__init__::225::IOProcess::(_processLogs) (14438) Building response >Thread-25::DEBUG::2014-08-12 15:15:57,277::__init__::225::IOProcess::(_processLogs) (14438) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:57,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:57,277::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:15:57,278::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:15:57,278::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:15:57,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:15:57,278::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:15:57,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:15:57,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:15:57,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:15:57,279::__init__::225::IOProcess::(_processLogs) (14439) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:15:57,279::__init__::225::IOProcess::(_processLogs) (14439) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:15:57,279::__init__::225::IOProcess::(_processLogs) (14439) Building response >Thread-25::DEBUG::2014-08-12 15:15:57,279::__init__::225::IOProcess::(_processLogs) (14439) Queuing response >Thread-25::DEBUG::2014-08-12 15:15:57,279::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:15:57,280::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:58,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:58,297::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:15:58,311::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:15:59,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:15:59,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122086 s, 83.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:15:59,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3ca5d27-fe02-48dd-9bc7-a00212c00605`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:15:59,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:15:59,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538026', 'lastCheck': '2.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595013', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:15:59,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3ca5d27-fe02-48dd-9bc7-a00212c00605`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538026', 'lastCheck': '2.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595013', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:15:59,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3ca5d27-fe02-48dd-9bc7-a00212c00605`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:15:59,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:15:59,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:15:59,314::task::993::Storage.TaskManager.Task::(_decref) Task=`d3ca5d27-fe02-48dd-9bc7-a00212c00605`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:15:59,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:01,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:01,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120341 s, 85.1 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:16:01,823::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7b05c3f-444a-4712-a1fd-68161c269497`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:16:01,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:16:01,824::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:16:01,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7b05c3f-444a-4712-a1fd-68161c269497`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:16:01,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7b05c3f-444a-4712-a1fd-68161c269497`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:16:01,824::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:16:01,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:16:01,825::task::993::Storage.TaskManager.Task::(_decref) Task=`e7b05c3f-444a-4712-a1fd-68161c269497`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:16:01,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`467fbeaf-1ac9-4a7c-901a-b3c39971ec1b`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:16:01,825::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:16:01,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:16:01,826::task::1191::Storage.TaskManager.Task::(prepare) Task=`467fbeaf-1ac9-4a7c-901a-b3c39971ec1b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:16:01,826::task::595::Storage.TaskManager.Task::(_updateState) Task=`467fbeaf-1ac9-4a7c-901a-b3c39971ec1b`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:16:01,826::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:16:01,826::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:16:01,826::task::993::Storage.TaskManager.Task::(_decref) Task=`467fbeaf-1ac9-4a7c-901a-b3c39971ec1b`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:16:01,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`d99eca24-af16-4bd8-a8b7-37f425f6337f`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:16:01,827::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:16:01,827::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:16:01,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`d99eca24-af16-4bd8-a8b7-37f425f6337f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:16:01,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`d99eca24-af16-4bd8-a8b7-37f425f6337f`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:16:01,828::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:16:01,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:16:01,828::task::993::Storage.TaskManager.Task::(_decref) Task=`d99eca24-af16-4bd8-a8b7-37f425f6337f`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:16:01,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`47c014ff-8d4a-4c80-a701-9bb196b57cea`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:16:01,828::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:16:01,829::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:16:01,829::task::1191::Storage.TaskManager.Task::(prepare) Task=`47c014ff-8d4a-4c80-a701-9bb196b57cea`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:16:01,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`47c014ff-8d4a-4c80-a701-9bb196b57cea`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:16:01,829::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:16:01,829::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:16:01,829::task::993::Storage.TaskManager.Task::(_decref) Task=`47c014ff-8d4a-4c80-a701-9bb196b57cea`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:03,317::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:03,319::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:03,328::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:03,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:03,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122192 s, 83.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:16:05,007::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:16:05,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`10a4e0d3-727e-4a30-b005-6952c82a6783`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:05,008::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:16:05,020::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:05,020::task::1191::Storage.TaskManager.Task::(prepare) Task=`10a4e0d3-727e-4a30-b005-6952c82a6783`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:05,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`10a4e0d3-727e-4a30-b005-6952c82a6783`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:05,020::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:05,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:05,021::task::993::Storage.TaskManager.Task::(_decref) Task=`10a4e0d3-727e-4a30-b005-6952c82a6783`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:16:05,034::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:16:05,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`7952300f-a9fa-4652-81d0-9992f212890c`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:16:05,035::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:16:05,036::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`5acfcedf-f644-4c84-b07b-c979affe5f7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:16:05,036::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:16:05,036::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:16:05,036::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`5acfcedf-f644-4c84-b07b-c979affe5f7c`::Granted request >Thread-32::DEBUG::2014-08-12 15:16:05,037::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7952300f-a9fa-4652-81d0-9992f212890c`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:16:05,037::task::993::Storage.TaskManager.Task::(_decref) Task=`7952300f-a9fa-4652-81d0-9992f212890c`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:16:05,049::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:05,050::task::1191::Storage.TaskManager.Task::(prepare) Task=`7952300f-a9fa-4652-81d0-9992f212890c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:05,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`7952300f-a9fa-4652-81d0-9992f212890c`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:16:05,050::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:16:05,050::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:16:05,050::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:16:05,050::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:16:05,051::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:16:05,051::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:16:05,051::task::993::Storage.TaskManager.Task::(_decref) Task=`7952300f-a9fa-4652-81d0-9992f212890c`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:16:05,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:05,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120602 s, 84.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:16:07,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:16:07,286::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000761784 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:16:07,286::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:16:07,300::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621618 s, 6.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:16:07,303::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:07,303::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:16:07,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:07,303::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:07,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:07,304::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:07,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:07,304::__init__::225::IOProcess::(_processLogs) (14440) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:07,304::__init__::225::IOProcess::(_processLogs) (14440) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:07,304::__init__::225::IOProcess::(_processLogs) (14440) Building response >Thread-25::DEBUG::2014-08-12 15:16:07,304::__init__::225::IOProcess::(_processLogs) (14440) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:07,305::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:07,305::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:16:07,306::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:07,306::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:16:07,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:07,306::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:07,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:07,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:07,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:07,307::__init__::225::IOProcess::(_processLogs) (14441) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:07,307::__init__::225::IOProcess::(_processLogs) (14441) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:07,307::__init__::225::IOProcess::(_processLogs) (14441) Building response >Thread-25::DEBUG::2014-08-12 15:16:07,307::__init__::225::IOProcess::(_processLogs) (14441) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:07,307::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:07,308::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:16:07,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:07,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186488 s, 54.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:08,335::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:08,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:08,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:09,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:09,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122203 s, 83.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:16:11,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:11,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123754 s, 82.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:13,358::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:13,359::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:13,370::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:13,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:13,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148578 s, 68.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:16:14,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2e152c5-4a5f-4535-93f3-1a59f6b156e1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:14,444::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:16:14,444::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621618', 'lastCheck': '7.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761784', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:16:14,444::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2e152c5-4a5f-4535-93f3-1a59f6b156e1`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621618', 'lastCheck': '7.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761784', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:16:14,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2e152c5-4a5f-4535-93f3-1a59f6b156e1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:14,444::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:14,445::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:14,445::task::993::Storage.TaskManager.Task::(_decref) Task=`e2e152c5-4a5f-4535-93f3-1a59f6b156e1`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:16:14,466::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:16:15,070::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:16:15,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4095903-1816-4e03-b854-9bfd83a9cbed`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:15,071::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:16:15,102::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:15,102::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4095903-1816-4e03-b854-9bfd83a9cbed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:15,102::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4095903-1816-4e03-b854-9bfd83a9cbed`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:15,102::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:15,103::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:15,103::task::993::Storage.TaskManager.Task::(_decref) Task=`f4095903-1816-4e03-b854-9bfd83a9cbed`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:16:15,115::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:16:15,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a5a95e4-92d8-48b2-88bf-87405bb3e973`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:16:15,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:16:15,116::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f48d85b6-5f62-4d17-9458-83453a39d509`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:16:15,116::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:16:15,117::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:16:15,117::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f48d85b6-5f62-4d17-9458-83453a39d509`::Granted request >Thread-32::DEBUG::2014-08-12 15:16:15,117::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9a5a95e4-92d8-48b2-88bf-87405bb3e973`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:16:15,118::task::993::Storage.TaskManager.Task::(_decref) Task=`9a5a95e4-92d8-48b2-88bf-87405bb3e973`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:16:15,130::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:15,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a5a95e4-92d8-48b2-88bf-87405bb3e973`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:15,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a5a95e4-92d8-48b2-88bf-87405bb3e973`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:16:15,130::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:16:15,130::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:16:15,131::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:16:15,131::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:16:15,131::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:16:15,131::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:16:15,131::task::993::Storage.TaskManager.Task::(_decref) Task=`9a5a95e4-92d8-48b2-88bf-87405bb3e973`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:16:15,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:15,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143077 s, 71.6 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:16:17,300::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:16:17,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:16:17,318::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649688 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:16:17,336::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586637 s, 7.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:16:17,351::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:17,353::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:16:17,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:17,354::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:17,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:17,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:17,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:17,354::__init__::225::IOProcess::(_processLogs) (14442) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:17,354::__init__::225::IOProcess::(_processLogs) (14442) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:17,355::__init__::225::IOProcess::(_processLogs) (14442) Building response >Thread-25::DEBUG::2014-08-12 15:16:17,355::__init__::225::IOProcess::(_processLogs) (14442) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:17,355::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:17,355::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:16:17,358::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:17,358::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:16:17,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:17,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:17,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:17,358::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:17,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:17,359::__init__::225::IOProcess::(_processLogs) (14443) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:17,359::__init__::225::IOProcess::(_processLogs) (14443) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:17,359::__init__::225::IOProcess::(_processLogs) (14443) Building response >Thread-25::DEBUG::2014-08-12 15:16:17,359::__init__::225::IOProcess::(_processLogs) (14443) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:17,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:17,360::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:16:17,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:18,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124702 s, 82.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:18,376::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:18,377::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:18,381::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:20,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:20,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122631 s, 83.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:16:22,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:22,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125124 s, 81.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:23,388::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:23,399::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:23,400::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:24,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:24,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139625 s, 73.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:16:24,533::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::DEBUG::2014-08-12 15:16:25,148::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:16:25,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`c36ba00c-0ac1-46c7-9bb7-071b9054088f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:25,149::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:16:25,161::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:25,162::task::1191::Storage.TaskManager.Task::(prepare) Task=`c36ba00c-0ac1-46c7-9bb7-071b9054088f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:25,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`c36ba00c-0ac1-46c7-9bb7-071b9054088f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:25,162::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:25,162::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:25,162::task::993::Storage.TaskManager.Task::(_decref) Task=`c36ba00c-0ac1-46c7-9bb7-071b9054088f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:16:25,172::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:16:25,173::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9b83a3d-913d-41fc-93e2-a4ea01190adc`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:16:25,173::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:16:25,173::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`79787fd3-cf04-408f-a117-b2875265d56e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:16:25,174::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:16:25,174::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:16:25,174::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`79787fd3-cf04-408f-a117-b2875265d56e`::Granted request >Thread-32::DEBUG::2014-08-12 15:16:25,174::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a9b83a3d-913d-41fc-93e2-a4ea01190adc`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:16:25,175::task::993::Storage.TaskManager.Task::(_decref) Task=`a9b83a3d-913d-41fc-93e2-a4ea01190adc`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:16:25,187::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:25,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9b83a3d-913d-41fc-93e2-a4ea01190adc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:25,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9b83a3d-913d-41fc-93e2-a4ea01190adc`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:16:25,187::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:16:25,188::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:16:25,188::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:16:25,188::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:16:25,188::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:16:25,188::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:16:25,189::task::993::Storage.TaskManager.Task::(_decref) Task=`a9b83a3d-913d-41fc-93e2-a4ea01190adc`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:16:26,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:26,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188982 s, 54.2 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:16:27,336::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:16:27,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671595 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:16:27,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:16:27,372::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645095 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:16:27,375::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:27,376::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:16:27,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:27,376::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:27,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:27,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:27,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:27,377::__init__::225::IOProcess::(_processLogs) (14444) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:27,377::__init__::225::IOProcess::(_processLogs) (14444) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:27,377::__init__::225::IOProcess::(_processLogs) (14444) Building response >Thread-25::DEBUG::2014-08-12 15:16:27,377::__init__::225::IOProcess::(_processLogs) (14444) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:27,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:27,377::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:16:27,378::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:27,378::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:16:27,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:27,379::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:27,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:27,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:27,379::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:27,379::__init__::225::IOProcess::(_processLogs) (14445) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:27,380::__init__::225::IOProcess::(_processLogs) (14445) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:27,380::__init__::225::IOProcess::(_processLogs) (14445) Building response >Thread-25::DEBUG::2014-08-12 15:16:27,380::__init__::225::IOProcess::(_processLogs) (14445) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:27,380::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:27,380::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:16:28,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:28,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122034 s, 83.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:28,414::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:28,425::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:28,430::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:16:29,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`324888f7-12b5-4ccd-a4b1-84a49437b12a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:29,554::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:16:29,554::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645095', 'lastCheck': '2.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671595', 'lastCheck': '2.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:16:29,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`324888f7-12b5-4ccd-a4b1-84a49437b12a`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645095', 'lastCheck': '2.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671595', 'lastCheck': '2.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:16:29,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`324888f7-12b5-4ccd-a4b1-84a49437b12a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:29,555::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:29,555::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:29,555::task::993::Storage.TaskManager.Task::(_decref) Task=`324888f7-12b5-4ccd-a4b1-84a49437b12a`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:16:29,579::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:30,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:30,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153047 s, 66.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:16:32,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:32,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124404 s, 82.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:33,445::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:33,452::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:33,454::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:34,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:34,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121979 s, 83.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:16:35,207::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:16:35,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5c728d0-2e08-4728-832f-ef134de7233b`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:35,208::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:16:35,220::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:35,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5c728d0-2e08-4728-832f-ef134de7233b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:35,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5c728d0-2e08-4728-832f-ef134de7233b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:35,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:35,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:35,221::task::993::Storage.TaskManager.Task::(_decref) Task=`b5c728d0-2e08-4728-832f-ef134de7233b`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:16:35,233::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:16:35,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`9779af64-b71c-4bc7-89b3-fa26ea80d447`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:16:35,234::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:16:35,234::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`be7e2832-e2f8-4299-bfd2-d62e7df5ef99`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:16:35,234::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:16:35,235::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:16:35,235::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`be7e2832-e2f8-4299-bfd2-d62e7df5ef99`::Granted request >Thread-32::DEBUG::2014-08-12 15:16:35,235::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9779af64-b71c-4bc7-89b3-fa26ea80d447`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:16:35,235::task::993::Storage.TaskManager.Task::(_decref) Task=`9779af64-b71c-4bc7-89b3-fa26ea80d447`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:16:35,248::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:35,248::task::1191::Storage.TaskManager.Task::(prepare) Task=`9779af64-b71c-4bc7-89b3-fa26ea80d447`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:35,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`9779af64-b71c-4bc7-89b3-fa26ea80d447`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:16:35,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:16:35,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:16:35,249::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:16:35,249::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:16:35,249::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:16:35,249::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:16:35,249::task::993::Storage.TaskManager.Task::(_decref) Task=`9779af64-b71c-4bc7-89b3-fa26ea80d447`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:16:36,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:36,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122167 s, 83.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:16:37,351::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:16:37,362::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774261 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:16:37,382::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:16:37,393::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655208 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:16:37,396::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:37,396::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:16:37,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:37,397::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:37,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:37,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:37,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:37,397::__init__::225::IOProcess::(_processLogs) (14446) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:37,397::__init__::225::IOProcess::(_processLogs) (14446) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:37,398::__init__::225::IOProcess::(_processLogs) (14446) Building response >Thread-25::DEBUG::2014-08-12 15:16:37,398::__init__::225::IOProcess::(_processLogs) (14446) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:37,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:37,398::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:16:37,399::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:37,399::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:16:37,399::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:37,400::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:37,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:37,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:37,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:37,400::__init__::225::IOProcess::(_processLogs) (14447) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:37,400::__init__::225::IOProcess::(_processLogs) (14447) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:37,401::__init__::225::IOProcess::(_processLogs) (14447) Building response >Thread-25::DEBUG::2014-08-12 15:16:37,401::__init__::225::IOProcess::(_processLogs) (14447) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:37,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:37,401::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:38,461::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:38,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:38,481::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:38,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:38,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120915 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:16:40,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:40,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120832 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:16:42,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:42,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121358 s, 84.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:43,488::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:43,489::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:43,499::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:16:44,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bc69b05-83d9-465f-95a6-af120146cb4f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:44,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:16:44,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655208', 'lastCheck': '7.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774261', 'lastCheck': '7.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:16:44,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`6bc69b05-83d9-465f-95a6-af120146cb4f`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655208', 'lastCheck': '7.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774261', 'lastCheck': '7.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:16:44,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bc69b05-83d9-465f-95a6-af120146cb4f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:44,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:44,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:44,668::task::993::Storage.TaskManager.Task::(_decref) Task=`6bc69b05-83d9-465f-95a6-af120146cb4f`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:16:44,689::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:44,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:45,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123213 s, 83.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:16:45,265::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5c9330f5] >Thread-14::DEBUG::2014-08-12 15:16:45,266::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a0f4a85-0425-4be7-9118-88e083caa686`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:45,266::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:16:45,278::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:45,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a0f4a85-0425-4be7-9118-88e083caa686`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:45,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a0f4a85-0425-4be7-9118-88e083caa686`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:45,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:45,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:45,279::task::993::Storage.TaskManager.Task::(_decref) Task=`1a0f4a85-0425-4be7-9118-88e083caa686`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:16:45,293::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5c9330f5] >Thread-32::DEBUG::2014-08-12 15:16:45,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`0033c1a8-6ea9-40be-95ac-01f62a56967e`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:16:45,294::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:16:45,296::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`74de3fe1-a1ba-4979-a0bd-d629aac4c8f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:16:45,296::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:16:45,296::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:16:45,297::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`74de3fe1-a1ba-4979-a0bd-d629aac4c8f1`::Granted request >Thread-32::DEBUG::2014-08-12 15:16:45,297::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0033c1a8-6ea9-40be-95ac-01f62a56967e`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:16:45,297::task::993::Storage.TaskManager.Task::(_decref) Task=`0033c1a8-6ea9-40be-95ac-01f62a56967e`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:16:45,309::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:45,309::task::1191::Storage.TaskManager.Task::(prepare) Task=`0033c1a8-6ea9-40be-95ac-01f62a56967e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:45,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`0033c1a8-6ea9-40be-95ac-01f62a56967e`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:16:45,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:16:45,310::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:16:45,310::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:16:45,310::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:16:45,311::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:16:45,311::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:16:45,311::task::993::Storage.TaskManager.Task::(_decref) Task=`0033c1a8-6ea9-40be-95ac-01f62a56967e`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:16:47,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:47,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120406 s, 85.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:16:47,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:16:47,376::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598174 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:16:47,402::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:16:47,417::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00207115 s, 2.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:16:47,420::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:47,420::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:16:47,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:47,420::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:47,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:47,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:47,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:47,421::__init__::225::IOProcess::(_processLogs) (14448) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:47,421::__init__::225::IOProcess::(_processLogs) (14448) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:47,421::__init__::225::IOProcess::(_processLogs) (14448) Building response >Thread-25::DEBUG::2014-08-12 15:16:47,422::__init__::225::IOProcess::(_processLogs) (14448) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:47,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:47,422::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:16:47,423::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:47,423::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:16:47,423::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:47,423::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:47,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:47,424::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:47,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:47,424::__init__::225::IOProcess::(_processLogs) (14449) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:47,424::__init__::225::IOProcess::(_processLogs) (14449) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:47,424::__init__::225::IOProcess::(_processLogs) (14449) Building response >Thread-25::DEBUG::2014-08-12 15:16:47,424::__init__::225::IOProcess::(_processLogs) (14449) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:47,424::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:47,425::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:48,505::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:48,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:48,516::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:49,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:49,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121657 s, 84.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:16:51,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:51,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122307 s, 83.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:16:53,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:53,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121436 s, 84.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:53,523::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:53,524::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:53,534::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:16:54,569::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:16:55,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-08-12 15:16:55,329::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:16:55,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`f601d507-1b79-4f88-9db8-f238355c9019`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:55,333::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:16:55,371::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Dummy-31::DEBUG::2014-08-12 15:16:55,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200906 s, 51.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:16:55,373::task::1191::Storage.TaskManager.Task::(prepare) Task=`f601d507-1b79-4f88-9db8-f238355c9019`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:16:55,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`f601d507-1b79-4f88-9db8-f238355c9019`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:55,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:55,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:55,375::task::993::Storage.TaskManager.Task::(_decref) Task=`f601d507-1b79-4f88-9db8-f238355c9019`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:16:55,388::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:16:55,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`26c68e7c-f2c6-4279-b3db-6bd07e6d5fc1`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:16:55,390::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:16:55,392::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`af893498-d071-437a-87be-c6996f6c26bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:16:55,393::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:16:55,394::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:16:55,395::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`af893498-d071-437a-87be-c6996f6c26bc`::Granted request >Thread-32::DEBUG::2014-08-12 15:16:55,397::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`26c68e7c-f2c6-4279-b3db-6bd07e6d5fc1`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:16:55,397::task::993::Storage.TaskManager.Task::(_decref) Task=`26c68e7c-f2c6-4279-b3db-6bd07e6d5fc1`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:16:55,409::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:55,409::task::1191::Storage.TaskManager.Task::(prepare) Task=`26c68e7c-f2c6-4279-b3db-6bd07e6d5fc1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:16:55,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`26c68e7c-f2c6-4279-b3db-6bd07e6d5fc1`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:16:55,410::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:16:55,410::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:16:55,410::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:16:55,410::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:16:55,410::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:16:55,411::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:16:55,411::task::993::Storage.TaskManager.Task::(_decref) Task=`26c68e7c-f2c6-4279-b3db-6bd07e6d5fc1`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:16:57,377::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:16:57,389::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658854 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:16:57,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:57,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118977 s, 86.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:16:57,458::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:16:57,471::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637937 s, 6.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:16:57,483::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:57,484::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:16:57,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:57,485::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:57,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:57,486::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:57,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:57,487::__init__::225::IOProcess::(_processLogs) (14450) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:57,488::__init__::225::IOProcess::(_processLogs) (14450) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:57,488::__init__::225::IOProcess::(_processLogs) (14450) Building response >Thread-25::DEBUG::2014-08-12 15:16:57,489::__init__::225::IOProcess::(_processLogs) (14450) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:57,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:57,490::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:16:57,492::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:16:57,492::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:16:57,493::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:16:57,493::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:16:57,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:16:57,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:16:57,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:16:57,495::__init__::225::IOProcess::(_processLogs) (14451) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:16:57,496::__init__::225::IOProcess::(_processLogs) (14451) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:16:57,496::__init__::225::IOProcess::(_processLogs) (14451) Building response >Thread-25::DEBUG::2014-08-12 15:16:57,497::__init__::225::IOProcess::(_processLogs) (14451) Queuing response >Thread-25::DEBUG::2014-08-12 15:16:57,497::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:16:57,498::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:58,540::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:58,541::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:16:58,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:16:59,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:16:59,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014291 s, 71.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:16:59,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1224ef6-98fe-4349-bdc2-45aa3da85ad1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:16:59,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:16:59,786::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637937', 'lastCheck': '2.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658854', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:16:59,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1224ef6-98fe-4349-bdc2-45aa3da85ad1`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637937', 'lastCheck': '2.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658854', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:16:59,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1224ef6-98fe-4349-bdc2-45aa3da85ad1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:16:59,786::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:16:59,786::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:16:59,786::task::993::Storage.TaskManager.Task::(_decref) Task=`e1224ef6-98fe-4349-bdc2-45aa3da85ad1`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:16:59,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:01,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:01,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120954 s, 84.7 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:17:02,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9d1da88-2c07-4bd0-ac1c-158bbae297a8`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:17:02,723::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:17:02,723::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:17:02,724::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9d1da88-2c07-4bd0-ac1c-158bbae297a8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:17:02,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9d1da88-2c07-4bd0-ac1c-158bbae297a8`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:17:02,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:17:02,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:17:02,724::task::993::Storage.TaskManager.Task::(_decref) Task=`f9d1da88-2c07-4bd0-ac1c-158bbae297a8`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:17:02,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`f477b286-2d00-48fc-a2dc-e6d0178ccf28`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:17:02,725::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:17:02,725::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:17:02,725::task::1191::Storage.TaskManager.Task::(prepare) Task=`f477b286-2d00-48fc-a2dc-e6d0178ccf28`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:17:02,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`f477b286-2d00-48fc-a2dc-e6d0178ccf28`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:17:02,725::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:17:02,726::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:17:02,726::task::993::Storage.TaskManager.Task::(_decref) Task=`f477b286-2d00-48fc-a2dc-e6d0178ccf28`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:17:02,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9038391-6088-4391-931c-1139bd02467b`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:17:02,726::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:17:02,727::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:17:02,727::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9038391-6088-4391-931c-1139bd02467b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:17:02,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9038391-6088-4391-931c-1139bd02467b`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:17:02,727::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:17:02,727::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:17:02,727::task::993::Storage.TaskManager.Task::(_decref) Task=`c9038391-6088-4391-931c-1139bd02467b`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:17:02,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`dfa1a5d7-66f4-4778-9054-6202ef0649da`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:17:02,728::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:17:02,728::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:17:02,728::task::1191::Storage.TaskManager.Task::(prepare) Task=`dfa1a5d7-66f4-4778-9054-6202ef0649da`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:17:02,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`dfa1a5d7-66f4-4778-9054-6202ef0649da`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:17:02,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:17:02,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:17:02,729::task::993::Storage.TaskManager.Task::(_decref) Task=`dfa1a5d7-66f4-4778-9054-6202ef0649da`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:03,563::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:03,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:03,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:03,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:03,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121395 s, 84.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:17:05,427::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:17:05,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`56173f54-410e-431b-b765-646bff1d7502`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:05,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:17:05,440::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:05,440::task::1191::Storage.TaskManager.Task::(prepare) Task=`56173f54-410e-431b-b765-646bff1d7502`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:05,440::task::595::Storage.TaskManager.Task::(_updateState) Task=`56173f54-410e-431b-b765-646bff1d7502`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:05,440::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:05,440::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:05,440::task::993::Storage.TaskManager.Task::(_decref) Task=`56173f54-410e-431b-b765-646bff1d7502`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:17:05,454::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:17:05,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3188a74-f6e3-4585-95eb-628518384966`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:17:05,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:17:05,455::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`286faab3-ea1f-4eee-86b6-e03a41e4e6c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:17:05,455::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:17:05,456::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:17:05,456::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`286faab3-ea1f-4eee-86b6-e03a41e4e6c2`::Granted request >Thread-32::DEBUG::2014-08-12 15:17:05,456::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c3188a74-f6e3-4585-95eb-628518384966`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:17:05,456::task::993::Storage.TaskManager.Task::(_decref) Task=`c3188a74-f6e3-4585-95eb-628518384966`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:17:05,469::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:05,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3188a74-f6e3-4585-95eb-628518384966`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:05,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3188a74-f6e3-4585-95eb-628518384966`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:17:05,469::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:17:05,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:17:05,470::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:17:05,470::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:17:05,470::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:17:05,470::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:17:05,471::task::993::Storage.TaskManager.Task::(_decref) Task=`c3188a74-f6e3-4585-95eb-628518384966`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:17:05,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:05,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127605 s, 80.2 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:17:07,391::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:17:07,402::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713284 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:17:07,500::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:17:07,512::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058762 s, 7.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:17:07,516::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:17:07,516::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:17:07,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:07,516::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:07,516::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:07,516::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:07,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:07,517::__init__::225::IOProcess::(_processLogs) (14452) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:07,517::__init__::225::IOProcess::(_processLogs) (14452) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:07,517::__init__::225::IOProcess::(_processLogs) (14452) Building response >Thread-25::DEBUG::2014-08-12 15:17:07,517::__init__::225::IOProcess::(_processLogs) (14452) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:07,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:07,518::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:17:07,518::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:17:07,519::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:17:07,519::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:07,519::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:07,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:07,519::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:07,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:07,520::__init__::225::IOProcess::(_processLogs) (14453) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:07,520::__init__::225::IOProcess::(_processLogs) (14453) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:07,520::__init__::225::IOProcess::(_processLogs) (14453) Building response >Thread-25::DEBUG::2014-08-12 15:17:07,520::__init__::225::IOProcess::(_processLogs) (14453) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:07,520::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:07,520::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:17:07,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:07,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148829 s, 68.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:08,588::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:08,589::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:08,604::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:09,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:09,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120318 s, 85.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:17:11,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:12,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129534 s, 79.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:13,611::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:13,612::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:13,622::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:14,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:14,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134573 s, 76.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:17:14,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`a52bcf46-0c4a-4be6-974c-6a14cc15b0e5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:14,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:17:14,898::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058762', 'lastCheck': '7.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713284', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:17:14,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`a52bcf46-0c4a-4be6-974c-6a14cc15b0e5`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058762', 'lastCheck': '7.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713284', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:17:14,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`a52bcf46-0c4a-4be6-974c-6a14cc15b0e5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:14,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:14,899::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:14,899::task::993::Storage.TaskManager.Task::(_decref) Task=`a52bcf46-0c4a-4be6-974c-6a14cc15b0e5`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:17:14,921::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:17:15,486::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:17:15,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`18c42aad-c57d-4673-833f-5e376916aea9`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:15,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:17:15,499::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:15,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`18c42aad-c57d-4673-833f-5e376916aea9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:15,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`18c42aad-c57d-4673-833f-5e376916aea9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:15,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:15,499::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:15,500::task::993::Storage.TaskManager.Task::(_decref) Task=`18c42aad-c57d-4673-833f-5e376916aea9`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:17:15,512::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:17:15,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bcea3bd-bfc3-43cf-a00e-adf566e43ea8`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:17:15,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:17:15,513::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`da4a131b-5d24-44ab-ac80-e9616515ad10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:17:15,513::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:17:15,514::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:17:15,514::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`da4a131b-5d24-44ab-ac80-e9616515ad10`::Granted request >Thread-32::DEBUG::2014-08-12 15:17:15,514::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2bcea3bd-bfc3-43cf-a00e-adf566e43ea8`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:17:15,514::task::993::Storage.TaskManager.Task::(_decref) Task=`2bcea3bd-bfc3-43cf-a00e-adf566e43ea8`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:17:15,530::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:15,530::task::1191::Storage.TaskManager.Task::(prepare) Task=`2bcea3bd-bfc3-43cf-a00e-adf566e43ea8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:15,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bcea3bd-bfc3-43cf-a00e-adf566e43ea8`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:17:15,530::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:17:15,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:17:15,531::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:17:15,531::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:17:15,531::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:17:15,531::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:17:15,532::task::993::Storage.TaskManager.Task::(_decref) Task=`2bcea3bd-bfc3-43cf-a00e-adf566e43ea8`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:17:16,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:16,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0201588 s, 50.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:17:17,404::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:17:17,415::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747911 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:17:17,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:17:17,533::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060607 s, 6.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:17:17,536::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:17:17,537::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:17:17,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:17,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:17,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:17,537::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:17,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:17,538::__init__::225::IOProcess::(_processLogs) (14454) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:17,538::__init__::225::IOProcess::(_processLogs) (14454) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:17,538::__init__::225::IOProcess::(_processLogs) (14454) Building response >Thread-25::DEBUG::2014-08-12 15:17:17,538::__init__::225::IOProcess::(_processLogs) (14454) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:17,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:17,538::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:17:17,539::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:17:17,539::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:17:17,539::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:17,540::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:17,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:17,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:17,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:17,540::__init__::225::IOProcess::(_processLogs) (14455) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:17,540::__init__::225::IOProcess::(_processLogs) (14455) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:17,540::__init__::225::IOProcess::(_processLogs) (14455) Building response >Thread-25::DEBUG::2014-08-12 15:17:17,541::__init__::225::IOProcess::(_processLogs) (14455) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:17,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:17,541::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:17:18,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:18,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132082 s, 77.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:18,628::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:18,629::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:18,639::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:20,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:20,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0163002 s, 62.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:17:22,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:22,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123049 s, 83.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:23,646::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:23,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:23,657::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:24,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:24,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121525 s, 84.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:17:24,608::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Thread-14::DEBUG::2014-08-12 15:17:25,547::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:17:25,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`aad4baa0-0d77-464b-9765-c93c7687afcb`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:25,548::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:17:25,560::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:25,561::task::1191::Storage.TaskManager.Task::(prepare) Task=`aad4baa0-0d77-464b-9765-c93c7687afcb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:25,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`aad4baa0-0d77-464b-9765-c93c7687afcb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:25,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:25,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:25,561::task::993::Storage.TaskManager.Task::(_decref) Task=`aad4baa0-0d77-464b-9765-c93c7687afcb`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:17:25,573::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:17:25,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fdf8320-1302-434e-82fd-2c60b56a2944`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:17:25,573::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:17:25,574::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ca6ba317-e35c-44d0-bfbc-e11eca4f20cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:17:25,574::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:17:25,574::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:17:25,575::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ca6ba317-e35c-44d0-bfbc-e11eca4f20cd`::Granted request >Thread-32::DEBUG::2014-08-12 15:17:25,575::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4fdf8320-1302-434e-82fd-2c60b56a2944`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:17:25,575::task::993::Storage.TaskManager.Task::(_decref) Task=`4fdf8320-1302-434e-82fd-2c60b56a2944`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:17:25,587::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:25,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`4fdf8320-1302-434e-82fd-2c60b56a2944`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:25,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fdf8320-1302-434e-82fd-2c60b56a2944`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:17:25,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:17:25,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:17:25,589::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:17:25,589::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:17:25,589::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:17:25,589::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:17:25,589::task::993::Storage.TaskManager.Task::(_decref) Task=`4fdf8320-1302-434e-82fd-2c60b56a2944`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:17:26,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:26,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123745 s, 82.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:17:27,417::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:17:27,429::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663923 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:17:27,542::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:17:27,553::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598083 s, 6.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:17:27,557::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:17:27,557::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:17:27,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:27,557::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:27,557::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:27,557::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:27,558::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:27,558::__init__::225::IOProcess::(_processLogs) (14456) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:27,558::__init__::225::IOProcess::(_processLogs) (14456) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:27,558::__init__::225::IOProcess::(_processLogs) (14456) Building response >Thread-25::DEBUG::2014-08-12 15:17:27,558::__init__::225::IOProcess::(_processLogs) (14456) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:27,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:27,559::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:17:27,559::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:17:27,559::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:17:27,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:27,560::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:27,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:27,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:27,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:27,560::__init__::225::IOProcess::(_processLogs) (14457) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:27,561::__init__::225::IOProcess::(_processLogs) (14457) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:27,561::__init__::225::IOProcess::(_processLogs) (14457) Building response >Thread-25::DEBUG::2014-08-12 15:17:27,561::__init__::225::IOProcess::(_processLogs) (14457) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:27,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:27,561::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:17:28,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:28,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:28,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:28,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122737 s, 83.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:28,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:17:30,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`6afce10f-4cce-46c1-b3d1-97357e9d997b`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:30,010::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:17:30,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598083', 'lastCheck': '2.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663923', 'lastCheck': '2.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:17:30,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`6afce10f-4cce-46c1-b3d1-97357e9d997b`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598083', 'lastCheck': '2.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663923', 'lastCheck': '2.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:17:30,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`6afce10f-4cce-46c1-b3d1-97357e9d997b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:30,011::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:30,011::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:30,011::task::993::Storage.TaskManager.Task::(_decref) Task=`6afce10f-4cce-46c1-b3d1-97357e9d997b`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:17:30,031::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:30,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:30,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121054 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:17:32,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:32,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121902 s, 84.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:33,716::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:33,717::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:33,737::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:34,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:34,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122074 s, 83.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:17:35,610::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [286df953] >Thread-14::DEBUG::2014-08-12 15:17:35,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4481ce5-e277-4d36-9859-b7e831d9410e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:35,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:17:35,624::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:35,624::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4481ce5-e277-4d36-9859-b7e831d9410e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:35,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4481ce5-e277-4d36-9859-b7e831d9410e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:35,624::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:35,624::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:35,624::task::993::Storage.TaskManager.Task::(_decref) Task=`c4481ce5-e277-4d36-9859-b7e831d9410e`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:17:35,637::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [286df953] >Thread-32::DEBUG::2014-08-12 15:17:35,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`4186ca44-9432-422c-87c0-3a72ca0d2aae`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:17:35,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:17:35,638::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a0e3f19e-7fbd-4d1d-995b-b6354d835a3d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:17:35,639::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:17:35,639::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:17:35,639::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a0e3f19e-7fbd-4d1d-995b-b6354d835a3d`::Granted request >Thread-32::DEBUG::2014-08-12 15:17:35,639::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4186ca44-9432-422c-87c0-3a72ca0d2aae`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:17:35,640::task::993::Storage.TaskManager.Task::(_decref) Task=`4186ca44-9432-422c-87c0-3a72ca0d2aae`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:17:35,652::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:35,652::task::1191::Storage.TaskManager.Task::(prepare) Task=`4186ca44-9432-422c-87c0-3a72ca0d2aae`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:35,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`4186ca44-9432-422c-87c0-3a72ca0d2aae`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:17:35,653::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:17:35,653::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:17:35,653::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:17:35,653::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:17:35,653::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:17:35,654::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:17:35,654::task::993::Storage.TaskManager.Task::(_decref) Task=`4186ca44-9432-422c-87c0-3a72ca0d2aae`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:17:36,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:36,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122607 s, 83.5 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:17:37,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:17:37,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690003 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:17:37,563::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:17:37,574::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739522 s, 5.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:17:37,577::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:17:37,578::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:17:37,578::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:37,578::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:37,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:37,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:37,578::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:37,579::__init__::225::IOProcess::(_processLogs) (14458) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:37,579::__init__::225::IOProcess::(_processLogs) (14458) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:37,579::__init__::225::IOProcess::(_processLogs) (14458) Building response >Thread-25::DEBUG::2014-08-12 15:17:37,579::__init__::225::IOProcess::(_processLogs) (14458) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:37,579::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:37,579::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:17:37,580::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:17:37,580::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:37,581::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:37,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:37,581::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:37,581::__init__::225::IOProcess::(_processLogs) (14459) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:37,581::__init__::225::IOProcess::(_processLogs) (14459) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:37,581::__init__::225::IOProcess::(_processLogs) (14459) Building response >Thread-25::DEBUG::2014-08-12 15:17:37,582::__init__::225::IOProcess::(_processLogs) (14459) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:37,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:37,582::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:38,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:38,746::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:38,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:39,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:39,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122771 s, 83.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:17:41,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:41,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120644 s, 84.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:17:43,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:43,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122529 s, 83.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:43,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:43,777::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:43,784::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:17:45,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3ae6141-9609-4023-bbdc-07ecbe5454df`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:45,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:17:45,145::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739522', 'lastCheck': '7.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690003', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:17:45,145::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3ae6141-9609-4023-bbdc-07ecbe5454df`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739522', 'lastCheck': '7.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690003', 'lastCheck': '7.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:17:45,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3ae6141-9609-4023-bbdc-07ecbe5454df`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:45,145::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:45,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:45,145::task::993::Storage.TaskManager.Task::(_decref) Task=`e3ae6141-9609-4023-bbdc-07ecbe5454df`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:17:45,180::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:45,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:45,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122037 s, 83.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:17:45,670::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:17:45,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffff8d5e-8810-4f8c-b346-51a3336fa9a2`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:45,670::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:17:45,702::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:45,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffff8d5e-8810-4f8c-b346-51a3336fa9a2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:45,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffff8d5e-8810-4f8c-b346-51a3336fa9a2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:45,703::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:45,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:45,703::task::993::Storage.TaskManager.Task::(_decref) Task=`ffff8d5e-8810-4f8c-b346-51a3336fa9a2`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:17:45,719::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:17:45,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9ae5a5d-f1bf-45f3-8f3a-c04f56e17627`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:17:45,720::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:17:45,720::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`be84ccfa-f012-4966-a7ce-86963ec77db5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:17:45,721::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:17:45,721::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:17:45,721::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`be84ccfa-f012-4966-a7ce-86963ec77db5`::Granted request >Thread-32::DEBUG::2014-08-12 15:17:45,721::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f9ae5a5d-f1bf-45f3-8f3a-c04f56e17627`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:17:45,722::task::993::Storage.TaskManager.Task::(_decref) Task=`f9ae5a5d-f1bf-45f3-8f3a-c04f56e17627`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:17:45,734::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:45,734::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9ae5a5d-f1bf-45f3-8f3a-c04f56e17627`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:45,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9ae5a5d-f1bf-45f3-8f3a-c04f56e17627`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:17:45,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:17:45,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:17:45,735::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:17:45,735::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:17:45,736::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:17:45,736::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:17:45,736::task::993::Storage.TaskManager.Task::(_decref) Task=`f9ae5a5d-f1bf-45f3-8f3a-c04f56e17627`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:17:47,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:47,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134043 s, 76.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:17:47,443::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:17:47,454::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605693 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:17:47,584::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:17:47,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610073 s, 6.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:17:47,598::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:17:47,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:47,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:47,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:47,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:47,599::__init__::225::IOProcess::(_processLogs) (14460) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:47,599::__init__::225::IOProcess::(_processLogs) (14460) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:47,600::__init__::225::IOProcess::(_processLogs) (14460) Building response >Thread-25::DEBUG::2014-08-12 15:17:47,600::__init__::225::IOProcess::(_processLogs) (14460) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:47,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:47,600::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:17:47,601::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:17:47,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:47,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:47,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:47,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:47,602::__init__::225::IOProcess::(_processLogs) (14461) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:47,602::__init__::225::IOProcess::(_processLogs) (14461) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:47,602::__init__::225::IOProcess::(_processLogs) (14461) Building response >Thread-25::DEBUG::2014-08-12 15:17:47,602::__init__::225::IOProcess::(_processLogs) (14461) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:47,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:47,602::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:48,793::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:48,793::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:48,804::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:49,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:49,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129708 s, 78.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:17:51,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:51,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129621 s, 79.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:17:53,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:53,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139915 s, 73.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:53,811::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:53,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:53,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:17:54,668::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:17:55,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:55,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121172 s, 84.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:17:55,751::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:17:55,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`2937ab58-25c0-4d7b-8c2d-9812ead5d935`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:17:55,752::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:17:55,788::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:55,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`2937ab58-25c0-4d7b-8c2d-9812ead5d935`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:17:55,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`2937ab58-25c0-4d7b-8c2d-9812ead5d935`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:17:55,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:17:55,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:17:55,789::task::993::Storage.TaskManager.Task::(_decref) Task=`2937ab58-25c0-4d7b-8c2d-9812ead5d935`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:17:55,801::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:17:55,801::task::595::Storage.TaskManager.Task::(_updateState) Task=`39923d6a-cb8f-4a55-a50f-e2c59dfa49ce`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:17:55,801::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:17:55,802::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8317ebaa-2d7d-4a6b-b7f4-17dc1a534aa7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:17:55,802::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:17:55,802::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:17:55,802::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8317ebaa-2d7d-4a6b-b7f4-17dc1a534aa7`::Granted request >Thread-32::DEBUG::2014-08-12 15:17:55,803::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`39923d6a-cb8f-4a55-a50f-e2c59dfa49ce`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:17:55,803::task::993::Storage.TaskManager.Task::(_decref) Task=`39923d6a-cb8f-4a55-a50f-e2c59dfa49ce`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:17:55,817::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:55,817::task::1191::Storage.TaskManager.Task::(prepare) Task=`39923d6a-cb8f-4a55-a50f-e2c59dfa49ce`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:17:55,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`39923d6a-cb8f-4a55-a50f-e2c59dfa49ce`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:17:55,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:17:55,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:17:55,818::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:17:55,818::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:17:55,819::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:17:55,819::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:17:55,819::task::993::Storage.TaskManager.Task::(_decref) Task=`39923d6a-cb8f-4a55-a50f-e2c59dfa49ce`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:17:57,456::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:17:57,467::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000928982 s, 4.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:17:57,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:17:57,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681772 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:17:57,618::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:17:57,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:17:57,619::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:57,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:57,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:57,620::__init__::225::IOProcess::(_processLogs) (14462) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:57,620::__init__::225::IOProcess::(_processLogs) (14462) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:57,620::__init__::225::IOProcess::(_processLogs) (14462) Building response >Thread-25::DEBUG::2014-08-12 15:17:57,620::__init__::225::IOProcess::(_processLogs) (14462) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:57,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:57,620::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:17:57,621::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:17:57,621::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:17:57,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:17:57,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:17:57,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:17:57,622::__init__::225::IOProcess::(_processLogs) (14463) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:17:57,622::__init__::225::IOProcess::(_processLogs) (14463) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:17:57,622::__init__::225::IOProcess::(_processLogs) (14463) Queuing response >Thread-25::DEBUG::2014-08-12 15:17:57,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:17:57,623::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:17:57,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:57,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122515 s, 83.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:58,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:58,820::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:17:58,827::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:17:59,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:17:59,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121155 s, 84.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:18:00,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`898d3314-e0cb-46d9-8fc0-2ed1f809af16`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:00,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:18:00,277::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681772', 'lastCheck': '2.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000928982', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:18:00,277::task::1191::Storage.TaskManager.Task::(prepare) Task=`898d3314-e0cb-46d9-8fc0-2ed1f809af16`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681772', 'lastCheck': '2.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000928982', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:18:00,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`898d3314-e0cb-46d9-8fc0-2ed1f809af16`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:00,278::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:00,278::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:00,278::task::993::Storage.TaskManager.Task::(_decref) Task=`898d3314-e0cb-46d9-8fc0-2ed1f809af16`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:18:00,302::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:01,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:01,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119944 s, 85.4 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:18:03,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`35225370-a8ee-4de9-96f7-116fe41a6d27`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:18:03,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:18:03,663::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:18:03,663::task::1191::Storage.TaskManager.Task::(prepare) Task=`35225370-a8ee-4de9-96f7-116fe41a6d27`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:18:03,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`35225370-a8ee-4de9-96f7-116fe41a6d27`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:18:03,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:18:03,663::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:18:03,663::task::993::Storage.TaskManager.Task::(_decref) Task=`35225370-a8ee-4de9-96f7-116fe41a6d27`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:18:03,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cde705b-0a5b-448b-ab81-62e2b4129bc5`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:18:03,664::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:18:03,664::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:18:03,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`3cde705b-0a5b-448b-ab81-62e2b4129bc5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:18:03,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cde705b-0a5b-448b-ab81-62e2b4129bc5`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:18:03,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:18:03,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:18:03,665::task::993::Storage.TaskManager.Task::(_decref) Task=`3cde705b-0a5b-448b-ab81-62e2b4129bc5`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:18:03,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`be6f1c50-cb3e-4b88-99c8-3df85c0045dd`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:18:03,665::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:18:03,666::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:18:03,666::task::1191::Storage.TaskManager.Task::(prepare) Task=`be6f1c50-cb3e-4b88-99c8-3df85c0045dd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:18:03,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`be6f1c50-cb3e-4b88-99c8-3df85c0045dd`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:18:03,666::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:18:03,666::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:18:03,666::task::993::Storage.TaskManager.Task::(_decref) Task=`be6f1c50-cb3e-4b88-99c8-3df85c0045dd`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:18:03,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`68284484-be5f-4c06-8a74-4e1419a7afe5`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:18:03,667::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:18:03,667::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:18:03,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`68284484-be5f-4c06-8a74-4e1419a7afe5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:18:03,668::task::595::Storage.TaskManager.Task::(_updateState) Task=`68284484-be5f-4c06-8a74-4e1419a7afe5`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:18:03,668::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:18:03,668::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:18:03,668::task::993::Storage.TaskManager.Task::(_decref) Task=`68284484-be5f-4c06-8a74-4e1419a7afe5`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:03,834::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:03,835::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:03,851::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:03,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:03,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130284 s, 78.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:18:05,843::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:18:05,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`07792999-e7e1-42d2-aa4d-75d4c85ee76f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:05,844::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:18:05,887::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:05,887::task::1191::Storage.TaskManager.Task::(prepare) Task=`07792999-e7e1-42d2-aa4d-75d4c85ee76f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:05,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`07792999-e7e1-42d2-aa4d-75d4c85ee76f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:05,887::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:05,887::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:05,887::task::993::Storage.TaskManager.Task::(_decref) Task=`07792999-e7e1-42d2-aa4d-75d4c85ee76f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:18:05,899::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:18:05,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`15370d66-6955-4ec9-96d5-0abd5534d178`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:18:05,900::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:18:05,901::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c0447c42-1097-4cf9-9b22-c943ff641c8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:18:05,901::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:18:05,901::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:18:05,901::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c0447c42-1097-4cf9-9b22-c943ff641c8a`::Granted request >Thread-32::DEBUG::2014-08-12 15:18:05,903::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`15370d66-6955-4ec9-96d5-0abd5534d178`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:18:05,903::task::993::Storage.TaskManager.Task::(_decref) Task=`15370d66-6955-4ec9-96d5-0abd5534d178`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:18:05,915::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:05,916::task::1191::Storage.TaskManager.Task::(prepare) Task=`15370d66-6955-4ec9-96d5-0abd5534d178`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:05,916::task::595::Storage.TaskManager.Task::(_updateState) Task=`15370d66-6955-4ec9-96d5-0abd5534d178`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:18:05,916::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:18:05,916::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:18:05,916::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:18:05,917::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:18:05,917::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:18:05,917::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:18:05,917::task::993::Storage.TaskManager.Task::(_decref) Task=`15370d66-6955-4ec9-96d5-0abd5534d178`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:18:05,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:06,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121146 s, 84.5 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:18:07,469::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:18:07,481::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747094 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:18:07,624::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:18:07,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618483 s, 6.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:18:07,639::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:18:07,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:18:07,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:07,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:18:07,640::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:07,640::__init__::225::IOProcess::(_processLogs) (14464) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:07,640::__init__::225::IOProcess::(_processLogs) (14464) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:07,640::__init__::225::IOProcess::(_processLogs) (14464) Building response >Thread-25::DEBUG::2014-08-12 15:18:07,640::__init__::225::IOProcess::(_processLogs) (14464) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:07,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:07,641::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:18:07,641::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:07,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:07,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:18:07,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:07,642::__init__::225::IOProcess::(_processLogs) (14465) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:07,642::__init__::225::IOProcess::(_processLogs) (14465) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:07,642::__init__::225::IOProcess::(_processLogs) (14465) Building response >Thread-25::DEBUG::2014-08-12 15:18:07,643::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:07,643::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:18:08,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:08,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01244 s, 82.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:08,858::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:08,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:08,868::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:10,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:10,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123483 s, 82.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:18:12,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:12,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121702 s, 84.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:13,875::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:13,876::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:13,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:14,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:14,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012321 s, 83.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:18:15,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`637b585d-fbbc-46d2-8f0f-41aa662c0df6`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:15,417::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:18:15,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618483', 'lastCheck': '7.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000747094', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:18:15,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`637b585d-fbbc-46d2-8f0f-41aa662c0df6`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618483', 'lastCheck': '7.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000747094', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:18:15,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`637b585d-fbbc-46d2-8f0f-41aa662c0df6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:15,418::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:15,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:15,418::task::993::Storage.TaskManager.Task::(_decref) Task=`637b585d-fbbc-46d2-8f0f-41aa662c0df6`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:18:15,440::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:18:15,934::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [35d38f32] >Thread-14::DEBUG::2014-08-12 15:18:15,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e8d1b25-acfa-450e-8dac-458265a607d2`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:15,936::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:18:15,980::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:15,981::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e8d1b25-acfa-450e-8dac-458265a607d2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:15,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e8d1b25-acfa-450e-8dac-458265a607d2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:15,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:15,983::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:15,984::task::993::Storage.TaskManager.Task::(_decref) Task=`9e8d1b25-acfa-450e-8dac-458265a607d2`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:18:16,070::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [35d38f32] >Thread-32::DEBUG::2014-08-12 15:18:16,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a27ce0c-0679-4d31-8760-cff182cfd814`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:18:16,073::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:18:16,076::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c3f202f2-9656-4fcf-9507-2e598dfb0ef4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:18:16,076::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:18:16,078::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:18:16,079::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c3f202f2-9656-4fcf-9507-2e598dfb0ef4`::Granted request >Thread-32::DEBUG::2014-08-12 15:18:16,081::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0a27ce0c-0679-4d31-8760-cff182cfd814`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:18:16,082::task::993::Storage.TaskManager.Task::(_decref) Task=`0a27ce0c-0679-4d31-8760-cff182cfd814`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:18:16,097::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:16,098::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a27ce0c-0679-4d31-8760-cff182cfd814`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:16,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a27ce0c-0679-4d31-8760-cff182cfd814`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:18:16,100::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:18:16,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:18:16,101::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:18:16,102::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:18:16,102::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:18:16,103::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:18:16,104::task::993::Storage.TaskManager.Task::(_decref) Task=`0a27ce0c-0679-4d31-8760-cff182cfd814`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:18:16,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:16,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.019395 s, 52.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:18:17,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:18:17,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596578 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:18:17,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:18:17,658::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747767 s, 5.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:18:17,661::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:18:17,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:18:17,661::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:17,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:17,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:17,662::__init__::225::IOProcess::(_processLogs) (14466) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:17,662::__init__::225::IOProcess::(_processLogs) (14466) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:17,662::__init__::225::IOProcess::(_processLogs) (14466) Building response >Thread-25::DEBUG::2014-08-12 15:18:17,662::__init__::225::IOProcess::(_processLogs) (14466) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:17,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:17,663::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:18:17,663::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:18:17,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:18:17,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:17,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:18:17,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:17,664::__init__::225::IOProcess::(_processLogs) (14467) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:17,664::__init__::225::IOProcess::(_processLogs) (14467) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:17,665::__init__::225::IOProcess::(_processLogs) (14467) Building response >Thread-25::DEBUG::2014-08-12 15:18:17,665::__init__::225::IOProcess::(_processLogs) (14467) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:17,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:17,665::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:18:18,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:18,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012452 s, 82.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:18,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:18,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:18,904::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:20,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:20,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121626 s, 84.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:18:22,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:22,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121831 s, 84.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:23,910::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:23,911::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:23,921::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:24,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-12 15:18:24,713::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:18:24,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014066 s, 72.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:18:26,126::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:18:26,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`90dc996c-87ae-47b9-992f-38b79193d2a4`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:26,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:18:26,164::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:26,164::task::1191::Storage.TaskManager.Task::(prepare) Task=`90dc996c-87ae-47b9-992f-38b79193d2a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:26,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`90dc996c-87ae-47b9-992f-38b79193d2a4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:26,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:26,165::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:26,165::task::993::Storage.TaskManager.Task::(_decref) Task=`90dc996c-87ae-47b9-992f-38b79193d2a4`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:18:26,176::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:18:26,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`88f6e8de-2fdd-4346-8fda-e0298951fbf2`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:18:26,176::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:18:26,177::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`5ee0621f-23b9-4cd3-a578-21623f50c30a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:18:26,177::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:18:26,177::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:18:26,177::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`5ee0621f-23b9-4cd3-a578-21623f50c30a`::Granted request >Thread-32::DEBUG::2014-08-12 15:18:26,178::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`88f6e8de-2fdd-4346-8fda-e0298951fbf2`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:18:26,178::task::993::Storage.TaskManager.Task::(_decref) Task=`88f6e8de-2fdd-4346-8fda-e0298951fbf2`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:18:26,191::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:26,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`88f6e8de-2fdd-4346-8fda-e0298951fbf2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:26,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`88f6e8de-2fdd-4346-8fda-e0298951fbf2`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:18:26,191::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:18:26,191::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:18:26,192::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:18:26,192::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:18:26,192::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:18:26,192::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:18:26,192::task::993::Storage.TaskManager.Task::(_decref) Task=`88f6e8de-2fdd-4346-8fda-e0298951fbf2`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:18:26,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:26,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123711 s, 82.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:18:27,495::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:18:27,507::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746556 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:18:27,667::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:18:27,680::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000553809 s, 7.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:18:27,683::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:18:27,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:18:27,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:27,684::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:27,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:27,684::__init__::225::IOProcess::(_processLogs) (14468) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:27,684::__init__::225::IOProcess::(_processLogs) (14468) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:27,684::__init__::225::IOProcess::(_processLogs) (14468) Building response >Thread-25::DEBUG::2014-08-12 15:18:27,684::__init__::225::IOProcess::(_processLogs) (14468) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:27,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:27,685::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:18:27,686::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:18:27,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:27,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:27,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:18:27,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:27,687::__init__::225::IOProcess::(_processLogs) (14469) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:27,687::__init__::225::IOProcess::(_processLogs) (14469) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:27,687::__init__::225::IOProcess::(_processLogs) (14469) Building response >Thread-25::DEBUG::2014-08-12 15:18:27,687::__init__::225::IOProcess::(_processLogs) (14469) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:27,687::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:27,687::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:18:28,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:28,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0149318 s, 68.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:28,928::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:28,929::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:28,945::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:18:30,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9c3b524-e211-4345-b10d-5df4e1a97180`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:30,543::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:18:30,544::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553809', 'lastCheck': '2.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746556', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:18:30,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9c3b524-e211-4345-b10d-5df4e1a97180`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553809', 'lastCheck': '2.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746556', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:18:30,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9c3b524-e211-4345-b10d-5df4e1a97180`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:30,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:30,544::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:30,545::task::993::Storage.TaskManager.Task::(_decref) Task=`f9c3b524-e211-4345-b10d-5df4e1a97180`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:18:30,572::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:30,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:30,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235015 s, 43.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:18:32,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:33,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012607 s, 81.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:33,951::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:33,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:33,963::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:35,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:35,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122425 s, 83.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:18:36,206::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:18:36,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`62bfb389-9704-45b8-999d-ca2219661194`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:36,207::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:18:36,240::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:36,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`62bfb389-9704-45b8-999d-ca2219661194`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:36,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`62bfb389-9704-45b8-999d-ca2219661194`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:36,241::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:36,241::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:36,241::task::993::Storage.TaskManager.Task::(_decref) Task=`62bfb389-9704-45b8-999d-ca2219661194`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:18:36,257::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:18:36,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f5c3f6b-ab4c-4625-91fb-bb5bd8efab55`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:18:36,257::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:18:36,258::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c04cc383-6c6f-4ce4-b00e-1da1908a7acb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:18:36,258::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:18:36,258::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:18:36,259::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c04cc383-6c6f-4ce4-b00e-1da1908a7acb`::Granted request >Thread-32::DEBUG::2014-08-12 15:18:36,259::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8f5c3f6b-ab4c-4625-91fb-bb5bd8efab55`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:18:36,259::task::993::Storage.TaskManager.Task::(_decref) Task=`8f5c3f6b-ab4c-4625-91fb-bb5bd8efab55`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:18:36,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:36,272::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f5c3f6b-ab4c-4625-91fb-bb5bd8efab55`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:36,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f5c3f6b-ab4c-4625-91fb-bb5bd8efab55`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:18:36,272::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:18:36,273::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:18:36,273::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:18:36,273::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:18:36,273::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:18:36,273::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:18:36,274::task::993::Storage.TaskManager.Task::(_decref) Task=`8f5c3f6b-ab4c-4625-91fb-bb5bd8efab55`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:18:37,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:37,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121351 s, 84.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:18:37,509::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:18:37,521::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661499 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:18:37,689::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:18:37,700::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644927 s, 6.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:18:37,703::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:18:37,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:18:37,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:37,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:37,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:37,704::__init__::225::IOProcess::(_processLogs) (14470) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:37,704::__init__::225::IOProcess::(_processLogs) (14470) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:37,704::__init__::225::IOProcess::(_processLogs) (14470) Building response >Thread-25::DEBUG::2014-08-12 15:18:37,705::__init__::225::IOProcess::(_processLogs) (14470) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:37,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:37,705::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:18:37,706::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:18:37,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:18:37,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:37,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:18:37,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:37,707::__init__::225::IOProcess::(_processLogs) (14471) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:37,707::__init__::225::IOProcess::(_processLogs) (14471) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:37,707::__init__::225::IOProcess::(_processLogs) (14471) Building response >Thread-25::DEBUG::2014-08-12 15:18:37,707::__init__::225::IOProcess::(_processLogs) (14471) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:37,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:37,707::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:38,969::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:38,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:38,986::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:39,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:39,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120137 s, 85.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:18:41,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:41,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122323 s, 83.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:18:43,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:43,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122842 s, 83.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:43,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:43,994::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:44,004::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:45,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:45,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130701 s, 78.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:18:45,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac50b76a-45b7-4b22-a2f2-8b8ddec59989`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:45,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:18:45,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644927', 'lastCheck': '8.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661499', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:18:45,691::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac50b76a-45b7-4b22-a2f2-8b8ddec59989`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644927', 'lastCheck': '8.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661499', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:18:45,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac50b76a-45b7-4b22-a2f2-8b8ddec59989`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:45,691::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:45,691::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:45,692::task::993::Storage.TaskManager.Task::(_decref) Task=`ac50b76a-45b7-4b22-a2f2-8b8ddec59989`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:18:45,715::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:18:46,291::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:18:46,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ac90b6f-5e48-47f7-b7e3-f0dd80b03686`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:46,295::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:18:46,332::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:46,333::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ac90b6f-5e48-47f7-b7e3-f0dd80b03686`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:46,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ac90b6f-5e48-47f7-b7e3-f0dd80b03686`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:46,334::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:46,334::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:46,335::task::993::Storage.TaskManager.Task::(_decref) Task=`1ac90b6f-5e48-47f7-b7e3-f0dd80b03686`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:18:46,350::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:18:46,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4e10ce7-21b5-48a8-894f-2fb15bcf749b`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:18:46,352::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:18:46,355::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ca887f68-67ae-4bc4-8f5d-fd5136e95c49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:18:46,356::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:18:46,357::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:18:46,358::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ca887f68-67ae-4bc4-8f5d-fd5136e95c49`::Granted request >Thread-32::DEBUG::2014-08-12 15:18:46,360::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c4e10ce7-21b5-48a8-894f-2fb15bcf749b`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:18:46,361::task::993::Storage.TaskManager.Task::(_decref) Task=`c4e10ce7-21b5-48a8-894f-2fb15bcf749b`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:18:46,375::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:46,376::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4e10ce7-21b5-48a8-894f-2fb15bcf749b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:46,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4e10ce7-21b5-48a8-894f-2fb15bcf749b`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:18:46,377::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:18:46,378::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:18:46,380::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:18:46,381::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:18:46,381::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:18:46,382::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:18:46,383::task::993::Storage.TaskManager.Task::(_decref) Task=`c4e10ce7-21b5-48a8-894f-2fb15bcf749b`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:18:47,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:47,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129578 s, 79.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:18:47,557::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:18:47,570::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780678 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:18:47,709::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:18:47,721::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000808881 s, 5.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:18:47,724::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:18:47,724::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:18:47,724::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:47,724::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:47,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:47,725::__init__::225::IOProcess::(_processLogs) (14472) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:47,725::__init__::225::IOProcess::(_processLogs) (14472) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:47,725::__init__::225::IOProcess::(_processLogs) (14472) Building response >Thread-25::DEBUG::2014-08-12 15:18:47,725::__init__::225::IOProcess::(_processLogs) (14472) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:47,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:47,725::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:18:47,726::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:18:47,726::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:47,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:47,727::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:18:47,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:47,727::__init__::225::IOProcess::(_processLogs) (14473) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:47,727::__init__::225::IOProcess::(_processLogs) (14473) Building response >Thread-25::DEBUG::2014-08-12 15:18:47,727::__init__::225::IOProcess::(_processLogs) (14473) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:47,728::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:47,728::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:49,010::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:49,011::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:49,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:49,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:49,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132178 s, 77.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:18:51,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:51,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130872 s, 78.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:18:53,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:53,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134596 s, 76.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:54,028::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:54,029::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:54,039::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:18:54,752::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:18:55,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:55,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132963 s, 77.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:18:56,402::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:18:56,402::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cdda6d9-4ff4-4420-b78f-4b895ef5dc02`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:18:56,402::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:18:56,440::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:56,441::task::1191::Storage.TaskManager.Task::(prepare) Task=`3cdda6d9-4ff4-4420-b78f-4b895ef5dc02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:18:56,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cdda6d9-4ff4-4420-b78f-4b895ef5dc02`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:18:56,441::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:18:56,441::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:18:56,441::task::993::Storage.TaskManager.Task::(_decref) Task=`3cdda6d9-4ff4-4420-b78f-4b895ef5dc02`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:18:56,455::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:18:56,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ebfcd19-a072-47bb-9f6a-59c98bfecf4d`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:18:56,456::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:18:56,456::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`55847c38-5068-4f0f-871a-9afc7fd7ea64`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:18:56,457::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:18:56,457::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:18:56,457::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`55847c38-5068-4f0f-871a-9afc7fd7ea64`::Granted request >Thread-32::DEBUG::2014-08-12 15:18:56,457::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2ebfcd19-a072-47bb-9f6a-59c98bfecf4d`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:18:56,458::task::993::Storage.TaskManager.Task::(_decref) Task=`2ebfcd19-a072-47bb-9f6a-59c98bfecf4d`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:18:56,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:56,470::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ebfcd19-a072-47bb-9f6a-59c98bfecf4d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:18:56,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ebfcd19-a072-47bb-9f6a-59c98bfecf4d`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:18:56,471::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:18:56,471::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:18:56,471::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:18:56,471::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:18:56,472::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:18:56,472::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:18:56,472::task::993::Storage.TaskManager.Task::(_decref) Task=`2ebfcd19-a072-47bb-9f6a-59c98bfecf4d`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:18:57,573::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:18:57,584::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678025 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:18:57,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:18:57,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605881 s, 6.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:18:57,744::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:18:57,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:18:57,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:57,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:57,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:57,745::__init__::225::IOProcess::(_processLogs) (14474) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:57,745::__init__::225::IOProcess::(_processLogs) (14474) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:18:57,745::__init__::225::IOProcess::(_processLogs) (14474) Building response >Thread-25::DEBUG::2014-08-12 15:18:57,745::__init__::225::IOProcess::(_processLogs) (14474) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:57,745::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:57,746::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:18:57,746::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:18:57,747::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:18:57,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:18:57,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:18:57,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:18:57,747::__init__::225::IOProcess::(_processLogs) (14475) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:18:57,747::__init__::225::IOProcess::(_processLogs) (14475) Building response >Thread-25::DEBUG::2014-08-12 15:18:57,748::__init__::225::IOProcess::(_processLogs) (14475) Queuing response >Thread-25::DEBUG::2014-08-12 15:18:57,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:18:57,748::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:18:57,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:18:57,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130061 s, 78.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:59,045::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:59,046::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:18:59,056::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:18:59,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:00,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0166997 s, 61.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:00,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac4fc96c-ea10-4291-a61c-d85c55143c82`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:00,807::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:19:00,808::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605881', 'lastCheck': '3.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678025', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:19:00,808::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac4fc96c-ea10-4291-a61c-d85c55143c82`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605881', 'lastCheck': '3.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678025', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:19:00,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac4fc96c-ea10-4291-a61c-d85c55143c82`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:00,808::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:00,808::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:00,809::task::993::Storage.TaskManager.Task::(_decref) Task=`ac4fc96c-ea10-4291-a61c-d85c55143c82`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:19:00,831::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:02,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:02,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013358 s, 76.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:04,063::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:04,063::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:04,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:04,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:04,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130821 s, 78.3 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:19:04,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c464c5b-1e1c-44ab-b82d-9a70b09afc49`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:19:04,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:19:04,510::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:19:04,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c464c5b-1e1c-44ab-b82d-9a70b09afc49`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:19:04,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c464c5b-1e1c-44ab-b82d-9a70b09afc49`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:19:04,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:19:04,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:19:04,511::task::993::Storage.TaskManager.Task::(_decref) Task=`5c464c5b-1e1c-44ab-b82d-9a70b09afc49`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:19:04,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8c48d9a-50bc-46df-a124-0d1e6daa5580`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:19:04,512::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:19:04,512::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:19:04,512::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8c48d9a-50bc-46df-a124-0d1e6daa5580`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:19:04,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8c48d9a-50bc-46df-a124-0d1e6daa5580`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:19:04,513::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:19:04,513::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:19:04,513::task::993::Storage.TaskManager.Task::(_decref) Task=`d8c48d9a-50bc-46df-a124-0d1e6daa5580`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:19:04,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`577721d7-e6e6-4576-b9e1-63b4afd6fcf1`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:19:04,513::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:19:04,514::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:19:04,514::task::1191::Storage.TaskManager.Task::(prepare) Task=`577721d7-e6e6-4576-b9e1-63b4afd6fcf1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:19:04,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`577721d7-e6e6-4576-b9e1-63b4afd6fcf1`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:19:04,514::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:19:04,514::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:19:04,514::task::993::Storage.TaskManager.Task::(_decref) Task=`577721d7-e6e6-4576-b9e1-63b4afd6fcf1`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:19:04,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`34b7fc5a-d8ec-4346-9348-2dd2e23fb3ee`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:19:04,515::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:19:04,515::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:19:04,515::task::1191::Storage.TaskManager.Task::(prepare) Task=`34b7fc5a-d8ec-4346-9348-2dd2e23fb3ee`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:19:04,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`34b7fc5a-d8ec-4346-9348-2dd2e23fb3ee`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:19:04,516::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:19:04,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:19:04,516::task::993::Storage.TaskManager.Task::(_decref) Task=`34b7fc5a-d8ec-4346-9348-2dd2e23fb3ee`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:19:06,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:06,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146132 s, 70.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:06,488::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:19:06,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`56504897-d3c0-4c1c-bf65-60a1d686d390`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:06,489::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:19:06,533::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:06,533::task::1191::Storage.TaskManager.Task::(prepare) Task=`56504897-d3c0-4c1c-bf65-60a1d686d390`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:06,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`56504897-d3c0-4c1c-bf65-60a1d686d390`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:06,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:06,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:06,534::task::993::Storage.TaskManager.Task::(_decref) Task=`56504897-d3c0-4c1c-bf65-60a1d686d390`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:19:06,546::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:19:06,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`79f1cf57-3d26-4e5b-9a47-04be71c5c368`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:19:06,547::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:19:06,547::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8335316a-a3bc-455d-b780-c5bf05e03a5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:19:06,548::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:19:06,548::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:19:06,548::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8335316a-a3bc-455d-b780-c5bf05e03a5e`::Granted request >Thread-32::DEBUG::2014-08-12 15:19:06,550::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`79f1cf57-3d26-4e5b-9a47-04be71c5c368`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:19:06,550::task::993::Storage.TaskManager.Task::(_decref) Task=`79f1cf57-3d26-4e5b-9a47-04be71c5c368`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:19:06,564::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:06,565::task::1191::Storage.TaskManager.Task::(prepare) Task=`79f1cf57-3d26-4e5b-9a47-04be71c5c368`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:06,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`79f1cf57-3d26-4e5b-9a47-04be71c5c368`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:19:06,565::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:19:06,565::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:19:06,565::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:19:06,566::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:19:06,566::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:19:06,566::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:19:06,566::task::993::Storage.TaskManager.Task::(_decref) Task=`79f1cf57-3d26-4e5b-9a47-04be71c5c368`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:19:07,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:19:07,598::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112807 s, 3.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:19:07,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:07,761::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627363 s, 6.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:19:07,764::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:19:07,764::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:07,764::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:07,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:19:07,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:07,765::__init__::225::IOProcess::(_processLogs) (14476) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:07,765::__init__::225::IOProcess::(_processLogs) (14476) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:07,765::__init__::225::IOProcess::(_processLogs) (14476) Building response >Thread-25::DEBUG::2014-08-12 15:19:07,765::__init__::225::IOProcess::(_processLogs) (14476) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:07,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:07,766::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:19:07,767::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:19:07,767::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:19:07,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:07,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:19:07,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:07,767::__init__::225::IOProcess::(_processLogs) (14477) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:07,767::__init__::225::IOProcess::(_processLogs) (14477) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:07,768::__init__::225::IOProcess::(_processLogs) (14477) Building response >Thread-25::DEBUG::2014-08-12 15:19:07,768::__init__::225::IOProcess::(_processLogs) (14477) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:07,769::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:19:08,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:08,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142594 s, 71.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:09,086::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:09,087::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:09,103::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:10,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:10,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130491 s, 78.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:19:12,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:12,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132901 s, 77.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:14,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:14,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:14,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:14,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:14,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130409 s, 78.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:15,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`683086eb-cf4f-4aac-beea-aa05d01122c9`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:15,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:19:15,940::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627363', 'lastCheck': '8.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112807', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:19:15,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`683086eb-cf4f-4aac-beea-aa05d01122c9`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627363', 'lastCheck': '8.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112807', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:19:15,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`683086eb-cf4f-4aac-beea-aa05d01122c9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:15,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:15,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:15,944::task::993::Storage.TaskManager.Task::(_decref) Task=`683086eb-cf4f-4aac-beea-aa05d01122c9`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:19:15,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:16,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:16,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.020134 s, 50.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:16,605::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:19:16,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`566b0143-57d1-4c13-b932-c6e4a8177ccd`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:16,613::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:19:16,627::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:16,628::task::1191::Storage.TaskManager.Task::(prepare) Task=`566b0143-57d1-4c13-b932-c6e4a8177ccd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:16,629::task::595::Storage.TaskManager.Task::(_updateState) Task=`566b0143-57d1-4c13-b932-c6e4a8177ccd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:16,630::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:16,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:16,632::task::993::Storage.TaskManager.Task::(_decref) Task=`566b0143-57d1-4c13-b932-c6e4a8177ccd`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:19:16,652::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:19:16,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff930319-7287-4247-a154-15bf1198bda6`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:19:16,658::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:19:16,665::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`79ada007-2ce2-467a-8b0f-541b303051f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:19:16,667::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:19:16,670::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:19:16,672::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`79ada007-2ce2-467a-8b0f-541b303051f5`::Granted request >Thread-32::DEBUG::2014-08-12 15:19:16,678::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff930319-7287-4247-a154-15bf1198bda6`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:19:16,680::task::993::Storage.TaskManager.Task::(_decref) Task=`ff930319-7287-4247-a154-15bf1198bda6`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:19:16,698::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:16,699::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff930319-7287-4247-a154-15bf1198bda6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:16,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff930319-7287-4247-a154-15bf1198bda6`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:19:16,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:19:16,702::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:19:16,703::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:19:16,705::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:19:16,706::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:19:16,707::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:19:16,708::task::993::Storage.TaskManager.Task::(_decref) Task=`ff930319-7287-4247-a154-15bf1198bda6`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:19:17,600::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:19:17,611::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071393 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:19:17,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:17,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589521 s, 6.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:19:17,785::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:19:17,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:17,785::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:19:17,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:17,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:17,786::__init__::225::IOProcess::(_processLogs) (14478) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:17,786::__init__::225::IOProcess::(_processLogs) (14478) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:17,786::__init__::225::IOProcess::(_processLogs) (14478) Building response >Thread-25::DEBUG::2014-08-12 15:19:17,786::__init__::225::IOProcess::(_processLogs) (14478) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:17,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:17,787::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:19:17,787::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:19:17,787::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:17,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:17,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:19:17,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:17,788::__init__::225::IOProcess::(_processLogs) (14479) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:17,788::__init__::225::IOProcess::(_processLogs) (14479) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:17,788::__init__::225::IOProcess::(_processLogs) (14479) Building response >Thread-25::DEBUG::2014-08-12 15:19:17,789::__init__::225::IOProcess::(_processLogs) (14479) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:17,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:17,789::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:19:18,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:18,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134632 s, 76.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:19,118::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:19,118::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:19,127::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:20,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:20,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129167 s, 79.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:19:22,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:22,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143561 s, 71.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:24,133::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:24,134::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:24,144::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:19:24,794::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:19:24,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:25,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121654 s, 84.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:26,739::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [138a6fee] >Thread-14::DEBUG::2014-08-12 15:19:26,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`299cac27-07bc-4ada-ba5c-f8dde318b4c8`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:26,740::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:19:26,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:26,752::task::1191::Storage.TaskManager.Task::(prepare) Task=`299cac27-07bc-4ada-ba5c-f8dde318b4c8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:26,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`299cac27-07bc-4ada-ba5c-f8dde318b4c8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:26,753::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:26,753::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:26,753::task::993::Storage.TaskManager.Task::(_decref) Task=`299cac27-07bc-4ada-ba5c-f8dde318b4c8`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:19:26,767::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [138a6fee] >Thread-32::DEBUG::2014-08-12 15:19:26,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`3028df3c-932d-42a9-9d4d-5753eabf00b6`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:19:26,767::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:19:26,768::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f937e677-9813-4275-9288-84da06dc7ad4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:19:26,768::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:19:26,768::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:19:26,769::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f937e677-9813-4275-9288-84da06dc7ad4`::Granted request >Thread-32::DEBUG::2014-08-12 15:19:26,769::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3028df3c-932d-42a9-9d4d-5753eabf00b6`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:19:26,769::task::993::Storage.TaskManager.Task::(_decref) Task=`3028df3c-932d-42a9-9d4d-5753eabf00b6`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:19:26,782::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:26,782::task::1191::Storage.TaskManager.Task::(prepare) Task=`3028df3c-932d-42a9-9d4d-5753eabf00b6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:26,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`3028df3c-932d-42a9-9d4d-5753eabf00b6`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:19:26,782::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:19:26,782::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:19:26,783::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:19:26,783::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:19:26,783::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:19:26,783::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:19:26,783::task::993::Storage.TaskManager.Task::(_decref) Task=`3028df3c-932d-42a9-9d4d-5753eabf00b6`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:19:27,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:27,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121261 s, 84.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:19:27,614::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:19:27,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000758819 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:19:27,790::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:27,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000570726 s, 7.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:19:27,804::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:19:27,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:27,805::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:19:27,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:27,805::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:27,805::__init__::225::IOProcess::(_processLogs) (14480) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:27,806::__init__::225::IOProcess::(_processLogs) (14480) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:27,806::__init__::225::IOProcess::(_processLogs) (14480) Building response >Thread-25::DEBUG::2014-08-12 15:19:27,806::__init__::225::IOProcess::(_processLogs) (14480) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:27,806::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:27,806::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:19:27,807::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:19:27,807::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:27,807::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:27,807::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:19:27,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:27,808::__init__::225::IOProcess::(_processLogs) (14481) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:27,808::__init__::225::IOProcess::(_processLogs) (14481) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:27,808::__init__::225::IOProcess::(_processLogs) (14481) Building response >Thread-25::DEBUG::2014-08-12 15:19:27,808::__init__::225::IOProcess::(_processLogs) (14481) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:27,808::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:27,808::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:19:29,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:29,154::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:29,161::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:29,162::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:29,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.301474 s, 3.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:31,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`008626b5-0c69-43aa-a552-3ec44893fcfd`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:31,106::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:19:31,107::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570726', 'lastCheck': '3.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000758819', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:19:31,107::task::1191::Storage.TaskManager.Task::(prepare) Task=`008626b5-0c69-43aa-a552-3ec44893fcfd`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570726', 'lastCheck': '3.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000758819', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:19:31,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`008626b5-0c69-43aa-a552-3ec44893fcfd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:31,107::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:31,107::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:31,108::task::993::Storage.TaskManager.Task::(_decref) Task=`008626b5-0c69-43aa-a552-3ec44893fcfd`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:19:31,130::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:31,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:31,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128207 s, 79.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:19:33,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:33,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122025 s, 83.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:34,169::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:34,170::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:34,185::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:35,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:35,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121577 s, 84.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:36,800::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:19:36,801::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c6f5946-68d9-4d19-af99-9420d61a7eb7`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:36,801::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:19:36,814::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:36,814::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c6f5946-68d9-4d19-af99-9420d61a7eb7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:36,814::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c6f5946-68d9-4d19-af99-9420d61a7eb7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:36,814::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:36,814::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:36,814::task::993::Storage.TaskManager.Task::(_decref) Task=`0c6f5946-68d9-4d19-af99-9420d61a7eb7`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:19:36,825::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:19:36,826::task::595::Storage.TaskManager.Task::(_updateState) Task=`29ffe6fb-89d2-49fa-99b8-1441c8b2195a`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:19:36,826::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:19:36,827::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a3bed34b-207d-4d6b-a60a-1e8030328c00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:19:36,827::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:19:36,827::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:19:36,827::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a3bed34b-207d-4d6b-a60a-1e8030328c00`::Granted request >Thread-32::DEBUG::2014-08-12 15:19:36,828::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`29ffe6fb-89d2-49fa-99b8-1441c8b2195a`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:19:36,828::task::993::Storage.TaskManager.Task::(_decref) Task=`29ffe6fb-89d2-49fa-99b8-1441c8b2195a`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:19:36,840::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:36,840::task::1191::Storage.TaskManager.Task::(prepare) Task=`29ffe6fb-89d2-49fa-99b8-1441c8b2195a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:36,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`29ffe6fb-89d2-49fa-99b8-1441c8b2195a`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:19:36,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:19:36,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:19:36,841::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:19:36,841::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:19:36,841::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:19:36,842::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:19:36,842::task::993::Storage.TaskManager.Task::(_decref) Task=`29ffe6fb-89d2-49fa-99b8-1441c8b2195a`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:19:37,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:19:37,639::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000789076 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:19:37,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:37,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121073 s, 84.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:19:37,810::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::DEBUG::2014-08-12 15:19:37,810::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:19:37,811::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:37,822::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000560089 s, 3.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:19:37,822::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000560089 s, 3.7 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:19:37,823::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:19:37,823::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:19:37,823::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:19:37,823::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:19:37,824::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:19:37,824::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:19:37,824::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:19:37,824::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:19:37,825::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:38,103::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:19:38,104::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:19:38,104::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::INFO::2014-08-12 15:19:38,105::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::INFO::2014-08-12 15:19:38,105::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::INFO::2014-08-12 15:19:38,106::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:19:38,106::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:38,275::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:19:38,276::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:38,287::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579895 s, 7.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:19:38,290::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:19:38,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:38,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:38,291::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:19:38,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:38,291::__init__::225::IOProcess::(_processLogs) (14482) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:38,291::__init__::225::IOProcess::(_processLogs) (14482) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:38,292::__init__::225::IOProcess::(_processLogs) (14482) Building response >Thread-25::DEBUG::2014-08-12 15:19:38,292::__init__::225::IOProcess::(_processLogs) (14482) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:38,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:38,292::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:19:38,293::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:19:38,293::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:19:38,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:38,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:19:38,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:38,294::__init__::225::IOProcess::(_processLogs) (14483) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:38,294::__init__::225::IOProcess::(_processLogs) (14483) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:38,294::__init__::225::IOProcess::(_processLogs) (14483) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:38,294::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:38,294::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:39,191::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:39,192::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:39,209::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:39,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:39,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132389 s, 77.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:19:41,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:41,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0145462 s, 70.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:19:43,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:43,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133088 s, 76.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:44,215::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:44,216::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:44,226::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:46,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:46,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252235 s, 40.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:46,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`afcd7810-c407-4be2-8006-6683494cde88`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:46,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:19:46,234::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579895', 'lastCheck': '7.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789076', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:19:46,235::task::1191::Storage.TaskManager.Task::(prepare) Task=`afcd7810-c407-4be2-8006-6683494cde88`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579895', 'lastCheck': '7.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789076', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:19:46,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`afcd7810-c407-4be2-8006-6683494cde88`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:46,237::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:46,238::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:46,239::task::993::Storage.TaskManager.Task::(_decref) Task=`afcd7810-c407-4be2-8006-6683494cde88`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:19:46,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:19:46,865::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [2f21dce0] >Thread-14::DEBUG::2014-08-12 15:19:46,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`b93ea325-f498-4114-ac60-63411d61542e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:46,866::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:19:46,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:46,886::task::1191::Storage.TaskManager.Task::(prepare) Task=`b93ea325-f498-4114-ac60-63411d61542e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:46,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`b93ea325-f498-4114-ac60-63411d61542e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:46,887::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:46,887::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:46,887::task::993::Storage.TaskManager.Task::(_decref) Task=`b93ea325-f498-4114-ac60-63411d61542e`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:19:46,995::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [2f21dce0] >Thread-32::DEBUG::2014-08-12 15:19:46,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`a14a5918-b439-4a2b-9c6f-229a6fab39f5`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:19:46,996::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:19:46,997::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`67e49631-f20c-4d57-946e-45faede025b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:19:46,997::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:19:46,997::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:19:46,997::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`67e49631-f20c-4d57-946e-45faede025b8`::Granted request >Thread-32::DEBUG::2014-08-12 15:19:46,998::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a14a5918-b439-4a2b-9c6f-229a6fab39f5`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:19:46,998::task::993::Storage.TaskManager.Task::(_decref) Task=`a14a5918-b439-4a2b-9c6f-229a6fab39f5`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:19:47,010::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:47,011::task::1191::Storage.TaskManager.Task::(prepare) Task=`a14a5918-b439-4a2b-9c6f-229a6fab39f5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:47,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`a14a5918-b439-4a2b-9c6f-229a6fab39f5`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:19:47,011::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:19:47,011::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:19:47,011::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:19:47,012::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:19:47,012::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:19:47,012::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:19:47,012::task::993::Storage.TaskManager.Task::(_decref) Task=`a14a5918-b439-4a2b-9c6f-229a6fab39f5`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:19:47,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:19:47,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067282 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:19:48,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:48,296::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:48,516::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.207816 s, 19.7 kB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:19:48,533::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:19:48,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:48,535::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:19:48,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:48,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:48,538::__init__::225::IOProcess::(_processLogs) (14484) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:48,539::__init__::225::IOProcess::(_processLogs) (14484) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:48,540::__init__::225::IOProcess::(_processLogs) (14484) Building response >Dummy-31::DEBUG::2014-08-12 15:19:48,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.32108 s, 3.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:19:48,576::__init__::225::IOProcess::(_processLogs) (14484) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:48,578::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:48,579::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:19:48,582::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:19:48,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:48,584::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:19:48,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:48,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:48,587::__init__::225::IOProcess::(_processLogs) (14485) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:48,588::__init__::225::IOProcess::(_processLogs) (14485) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:48,588::__init__::225::IOProcess::(_processLogs) (14485) Building response >Thread-25::DEBUG::2014-08-12 15:19:48,589::__init__::225::IOProcess::(_processLogs) (14485) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:48,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:48,591::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:49,232::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:49,233::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:49,244::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:50,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:50,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012109 s, 84.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:19:52,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:52,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123428 s, 83.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:54,250::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:54,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:54,267::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:19:54,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-12 15:19:54,866::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:19:55,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.260768 s, 3.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:57,042::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:19:57,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b222c3f-479c-4cbc-844a-a8470f3841a0`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:19:57,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Dummy-31::DEBUG::2014-08-12 15:19:57,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::INFO::2014-08-12 15:19:57,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Dummy-31::DEBUG::2014-08-12 15:19:57,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122525 s, 83.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:19:57,131::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b222c3f-479c-4cbc-844a-a8470f3841a0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:19:57,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b222c3f-479c-4cbc-844a-a8470f3841a0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:19:57,132::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:19:57,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:19:57,135::task::993::Storage.TaskManager.Task::(_decref) Task=`4b222c3f-479c-4cbc-844a-a8470f3841a0`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:19:57,148::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:19:57,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`5232c758-8edd-4096-b24f-fd15a380a371`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:19:57,149::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:19:57,149::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`85e00662-2255-463d-a14a-fdcb6210d86c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:19:57,150::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:19:57,150::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:19:57,150::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`85e00662-2255-463d-a14a-fdcb6210d86c`::Granted request >Thread-32::DEBUG::2014-08-12 15:19:57,150::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5232c758-8edd-4096-b24f-fd15a380a371`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:19:57,151::task::993::Storage.TaskManager.Task::(_decref) Task=`5232c758-8edd-4096-b24f-fd15a380a371`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:19:57,164::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:57,164::task::1191::Storage.TaskManager.Task::(prepare) Task=`5232c758-8edd-4096-b24f-fd15a380a371`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:19:57,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`5232c758-8edd-4096-b24f-fd15a380a371`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:19:57,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:19:57,164::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:19:57,165::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:19:57,165::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:19:57,165::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:19:57,165::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:19:57,165::task::993::Storage.TaskManager.Task::(_decref) Task=`5232c758-8edd-4096-b24f-fd15a380a371`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:19:57,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:19:57,665::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647519 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:19:58,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:19:58,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703134 s, 5.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:19:58,609::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:19:58,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:58,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:58,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:19:58,610::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:58,610::__init__::225::IOProcess::(_processLogs) (14486) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:58,610::__init__::225::IOProcess::(_processLogs) (14486) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:58,610::__init__::225::IOProcess::(_processLogs) (14486) Building response >Thread-25::DEBUG::2014-08-12 15:19:58,610::__init__::225::IOProcess::(_processLogs) (14486) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:58,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:58,611::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:19:58,611::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:19:58,612::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:19:58,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:19:58,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:19:58,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:19:58,612::__init__::225::IOProcess::(_processLogs) (14487) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:19:58,612::__init__::225::IOProcess::(_processLogs) (14487) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:19:58,613::__init__::225::IOProcess::(_processLogs) (14487) Building response >Thread-25::DEBUG::2014-08-12 15:19:58,613::__init__::225::IOProcess::(_processLogs) (14487) Queuing response >Thread-25::DEBUG::2014-08-12 15:19:58,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:19:58,613::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:19:59,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:19:59,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119931 s, 85.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:59,274::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:59,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:19:59,284::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:01,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:01,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121899 s, 84.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:20:01,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f062780-97a5-4444-9b21-a0b1a0aea7ad`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:01,422::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:20:01,423::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703134', 'lastCheck': '2.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647519', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:20:01,423::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f062780-97a5-4444-9b21-a0b1a0aea7ad`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703134', 'lastCheck': '2.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647519', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:20:01,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f062780-97a5-4444-9b21-a0b1a0aea7ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:01,423::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:01,423::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:01,423::task::993::Storage.TaskManager.Task::(_decref) Task=`9f062780-97a5-4444-9b21-a0b1a0aea7ad`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:20:01,447::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:03,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:03,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012409 s, 82.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:04,291::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:04,292::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:04,293::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:05,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:05,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122079 s, 83.9 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:20:05,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`edc3564b-1a51-43e8-88db-1099efb8c6cd`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:20:05,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:20:05,467::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:20:05,467::task::1191::Storage.TaskManager.Task::(prepare) Task=`edc3564b-1a51-43e8-88db-1099efb8c6cd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:20:05,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`edc3564b-1a51-43e8-88db-1099efb8c6cd`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:20:05,467::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:20:05,467::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:20:05,468::task::993::Storage.TaskManager.Task::(_decref) Task=`edc3564b-1a51-43e8-88db-1099efb8c6cd`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:20:05,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d4f3c7e-44b3-45c9-845a-3e96b7f084c3`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:20:05,468::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:20:05,469::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:20:05,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d4f3c7e-44b3-45c9-845a-3e96b7f084c3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:20:05,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d4f3c7e-44b3-45c9-845a-3e96b7f084c3`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:20:05,469::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:20:05,469::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:20:05,469::task::993::Storage.TaskManager.Task::(_decref) Task=`4d4f3c7e-44b3-45c9-845a-3e96b7f084c3`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:20:05,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ef2e72b-46a7-4a2c-8736-1278e3f5dfea`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:20:05,470::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:20:05,470::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:20:05,470::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ef2e72b-46a7-4a2c-8736-1278e3f5dfea`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:20:05,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ef2e72b-46a7-4a2c-8736-1278e3f5dfea`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:20:05,471::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:20:05,471::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:20:05,471::task::993::Storage.TaskManager.Task::(_decref) Task=`2ef2e72b-46a7-4a2c-8736-1278e3f5dfea`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:20:05,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c9aa14a-4228-4c12-8408-716cbefa81ef`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:20:05,471::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:20:05,472::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:20:05,472::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c9aa14a-4228-4c12-8408-716cbefa81ef`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:20:05,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c9aa14a-4228-4c12-8408-716cbefa81ef`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:20:05,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:20:05,472::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:20:05,472::task::993::Storage.TaskManager.Task::(_decref) Task=`1c9aa14a-4228-4c12-8408-716cbefa81ef`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:20:07,183::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:20:07,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c0cff75-0e49-4c4f-852e-011e8f5868a8`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:07,184::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:20:07,216::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:07,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c0cff75-0e49-4c4f-852e-011e8f5868a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:07,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c0cff75-0e49-4c4f-852e-011e8f5868a8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:07,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:07,217::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:07,217::task::993::Storage.TaskManager.Task::(_decref) Task=`4c0cff75-0e49-4c4f-852e-011e8f5868a8`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:20:07,228::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:20:07,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c01a71c-dfe3-47bc-b542-eb398667d100`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:20:07,229::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:20:07,229::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a7c406f4-1830-4d08-bb6d-f4fcbb02639b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:20:07,229::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:20:07,230::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:20:07,230::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a7c406f4-1830-4d08-bb6d-f4fcbb02639b`::Granted request >Thread-32::DEBUG::2014-08-12 15:20:07,230::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c01a71c-dfe3-47bc-b542-eb398667d100`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:20:07,230::task::993::Storage.TaskManager.Task::(_decref) Task=`6c01a71c-dfe3-47bc-b542-eb398667d100`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:20:07,243::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:07,243::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c01a71c-dfe3-47bc-b542-eb398667d100`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:07,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c01a71c-dfe3-47bc-b542-eb398667d100`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:20:07,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:20:07,244::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:20:07,244::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:20:07,244::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:20:07,244::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:20:07,245::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:20:07,245::task::993::Storage.TaskManager.Task::(_decref) Task=`6c01a71c-dfe3-47bc-b542-eb398667d100`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:20:07,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:07,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122066 s, 83.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:20:07,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:20:07,678::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591161 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:20:08,614::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:20:08,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607162 s, 6.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:20:08,630::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:20:08,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:08,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:20:08,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:08,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:08,631::__init__::225::IOProcess::(_processLogs) (14488) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:08,631::__init__::225::IOProcess::(_processLogs) (14488) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:08,631::__init__::225::IOProcess::(_processLogs) (14488) Building response >Thread-25::DEBUG::2014-08-12 15:20:08,631::__init__::225::IOProcess::(_processLogs) (14488) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:08,632::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:08,632::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:20:08,632::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:20:08,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:08,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:08,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:08,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:08,633::__init__::225::IOProcess::(_processLogs) (14489) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:08,633::__init__::225::IOProcess::(_processLogs) (14489) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:08,633::__init__::225::IOProcess::(_processLogs) (14489) Building response >Thread-25::DEBUG::2014-08-12 15:20:08,634::__init__::225::IOProcess::(_processLogs) (14489) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:08,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:08,634::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:09,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:09,297::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:09,297::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:09,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:09,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122469 s, 83.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:11,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:11,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120797 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:13,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:13,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012283 s, 83.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:14,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:14,305::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:14,306::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:15,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:15,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141496 s, 72.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:20:16,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`696c5a01-6dc9-4634-a38f-0e767c860d11`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:16,557::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:20:16,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607162', 'lastCheck': '7.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591161', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:20:16,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`696c5a01-6dc9-4634-a38f-0e767c860d11`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607162', 'lastCheck': '7.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591161', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:20:16,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`696c5a01-6dc9-4634-a38f-0e767c860d11`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:16,562::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:16,562::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:16,563::task::993::Storage.TaskManager.Task::(_decref) Task=`696c5a01-6dc9-4634-a38f-0e767c860d11`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:20:16,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:20:17,260::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5a13659a] >Thread-14::DEBUG::2014-08-12 15:20:17,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3764b98-bed8-484f-a935-6605523ab664`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:17,260::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:20:17,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:17,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3764b98-bed8-484f-a935-6605523ab664`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:17,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3764b98-bed8-484f-a935-6605523ab664`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:17,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:17,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:17,294::task::993::Storage.TaskManager.Task::(_decref) Task=`e3764b98-bed8-484f-a935-6605523ab664`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:20:17,305::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5a13659a] >Thread-32::DEBUG::2014-08-12 15:20:17,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`11592e6b-0908-467d-b7b0-ef948f0536c6`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:20:17,306::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:20:17,306::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`280b5760-b623-47ae-b946-27ed10a414f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:20:17,306::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:20:17,307::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:20:17,307::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`280b5760-b623-47ae-b946-27ed10a414f0`::Granted request >Thread-32::DEBUG::2014-08-12 15:20:17,307::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`11592e6b-0908-467d-b7b0-ef948f0536c6`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:20:17,307::task::993::Storage.TaskManager.Task::(_decref) Task=`11592e6b-0908-467d-b7b0-ef948f0536c6`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:20:17,320::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:17,320::task::1191::Storage.TaskManager.Task::(prepare) Task=`11592e6b-0908-467d-b7b0-ef948f0536c6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:17,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`11592e6b-0908-467d-b7b0-ef948f0536c6`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:20:17,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:20:17,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:20:17,321::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:20:17,321::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:20:17,321::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:20:17,321::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:20:17,321::task::993::Storage.TaskManager.Task::(_decref) Task=`11592e6b-0908-467d-b7b0-ef948f0536c6`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:20:17,679::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:20:17,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746082 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:17,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:17,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01386 s, 73.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:20:18,635::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:20:18,647::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654196 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:20:18,650::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:20:18,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:18,651::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:20:18,651::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:18,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:18,651::__init__::225::IOProcess::(_processLogs) (14490) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:18,651::__init__::225::IOProcess::(_processLogs) (14490) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:18,651::__init__::225::IOProcess::(_processLogs) (14490) Building response >Thread-25::DEBUG::2014-08-12 15:20:18,652::__init__::225::IOProcess::(_processLogs) (14490) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:18,652::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:18,652::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:20:18,653::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:20:18,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:18,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:18,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:18,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:18,654::__init__::225::IOProcess::(_processLogs) (14491) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:18,654::__init__::225::IOProcess::(_processLogs) (14491) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:18,654::__init__::225::IOProcess::(_processLogs) (14491) Building response >Thread-25::DEBUG::2014-08-12 15:20:18,654::__init__::225::IOProcess::(_processLogs) (14491) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:18,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:18,654::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:19,312::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:19,313::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:19,314::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:19,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:19,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121936 s, 84.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:21,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:22,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124318 s, 82.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:24,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:24,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123729 s, 82.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:24,321::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:24,322::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:24,322::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:20:24,936::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:20:26,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:26,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125415 s, 81.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:20:27,336::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:20:27,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`4254fab3-dae1-4742-9a51-3811dd33295a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:27,337::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:20:27,349::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:27,349::task::1191::Storage.TaskManager.Task::(prepare) Task=`4254fab3-dae1-4742-9a51-3811dd33295a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:27,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`4254fab3-dae1-4742-9a51-3811dd33295a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:27,350::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:27,350::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:27,350::task::993::Storage.TaskManager.Task::(_decref) Task=`4254fab3-dae1-4742-9a51-3811dd33295a`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:20:27,361::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:20:27,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`f474a960-66a9-4c2c-86a0-2680b4a70339`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:20:27,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:20:27,362::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`cd527fed-fe8d-4f7f-b1cf-a7e9110a7444`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:20:27,362::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:20:27,362::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:20:27,363::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`cd527fed-fe8d-4f7f-b1cf-a7e9110a7444`::Granted request >Thread-32::DEBUG::2014-08-12 15:20:27,363::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f474a960-66a9-4c2c-86a0-2680b4a70339`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:20:27,363::task::993::Storage.TaskManager.Task::(_decref) Task=`f474a960-66a9-4c2c-86a0-2680b4a70339`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:20:27,376::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:27,376::task::1191::Storage.TaskManager.Task::(prepare) Task=`f474a960-66a9-4c2c-86a0-2680b4a70339`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:27,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`f474a960-66a9-4c2c-86a0-2680b4a70339`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:20:27,376::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:20:27,377::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:20:27,377::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:20:27,377::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:20:27,377::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:20:27,377::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:20:27,378::task::993::Storage.TaskManager.Task::(_decref) Task=`f474a960-66a9-4c2c-86a0-2680b4a70339`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:20:27,693::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-33::DEBUG::2014-08-12 15:20:27,693::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:20:27,693::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:20:27,705::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000670867 s, 3.1 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:20:27,705::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000670867 s, 3.1 MB/s'], size: 2048 >Thread-33::DEBUG::2014-08-12 15:20:27,705::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-33::DEBUG::2014-08-12 15:20:27,705::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-33::DEBUG::2014-08-12 15:20:27,706::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:20:27,706::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:20:27,706::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:20:27,706::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:20:27,707::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:20:27,707::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:20:27,707::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:20:28,004::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:20:28,005::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:20:28,005::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-33::INFO::2014-08-12 15:20:28,006::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-33::INFO::2014-08-12 15:20:28,006::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-33::INFO::2014-08-12 15:20:28,006::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-33::DEBUG::2014-08-12 15:20:28,007::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:28,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:28,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126444 s, 81.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:20:28,222::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:20:28,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:20:28,235::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764608 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:20:28,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:20:28,667::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572973 s, 7.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:20:28,670::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:20:28,670::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:28,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:28,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:28,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:28,671::__init__::225::IOProcess::(_processLogs) (14492) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:28,671::__init__::225::IOProcess::(_processLogs) (14492) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:28,671::__init__::225::IOProcess::(_processLogs) (14492) Building response >Thread-25::DEBUG::2014-08-12 15:20:28,672::__init__::225::IOProcess::(_processLogs) (14492) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:28,672::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:28,672::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:20:28,673::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:20:28,673::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:20:28,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:28,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:28,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:28,674::__init__::225::IOProcess::(_processLogs) (14493) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:28,674::__init__::225::IOProcess::(_processLogs) (14493) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:28,674::__init__::225::IOProcess::(_processLogs) (14493) Building response >Thread-25::DEBUG::2014-08-12 15:20:28,674::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:28,674::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:29,329::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:29,330::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:29,330::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:30,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:30,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122281 s, 83.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:20:31,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`2392d363-06d6-4776-ba0b-bed9151f08ba`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:31,722::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:20:31,723::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572973', 'lastCheck': '3.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764608', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:20:31,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`2392d363-06d6-4776-ba0b-bed9151f08ba`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572973', 'lastCheck': '3.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764608', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:20:31,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`2392d363-06d6-4776-ba0b-bed9151f08ba`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:31,723::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:31,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:31,724::task::993::Storage.TaskManager.Task::(_decref) Task=`2392d363-06d6-4776-ba0b-bed9151f08ba`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:20:31,756::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:32,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:32,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120369 s, 85.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:34,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:34,338::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:34,338::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:34,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:34,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123227 s, 83.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:36,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:36,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122223 s, 83.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:20:37,393::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [42db2bf0] >Thread-14::DEBUG::2014-08-12 15:20:37,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ddf0af4-c81f-4a3b-ab5c-bbdf33f43ce7`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:37,394::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:20:37,406::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:37,407::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ddf0af4-c81f-4a3b-ab5c-bbdf33f43ce7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:37,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ddf0af4-c81f-4a3b-ab5c-bbdf33f43ce7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:37,407::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:37,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:37,407::task::993::Storage.TaskManager.Task::(_decref) Task=`9ddf0af4-c81f-4a3b-ab5c-bbdf33f43ce7`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:20:37,426::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [42db2bf0] >Thread-32::DEBUG::2014-08-12 15:20:37,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`f52f7f06-c74c-421d-abad-9d0fcac203af`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:20:37,426::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:20:37,427::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`7f317836-32f5-45c8-b047-ac132285fa83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:20:37,427::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:20:37,427::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:20:37,427::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`7f317836-32f5-45c8-b047-ac132285fa83`::Granted request >Thread-32::DEBUG::2014-08-12 15:20:37,428::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f52f7f06-c74c-421d-abad-9d0fcac203af`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:20:37,428::task::993::Storage.TaskManager.Task::(_decref) Task=`f52f7f06-c74c-421d-abad-9d0fcac203af`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:20:37,441::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:37,441::task::1191::Storage.TaskManager.Task::(prepare) Task=`f52f7f06-c74c-421d-abad-9d0fcac203af`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:37,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`f52f7f06-c74c-421d-abad-9d0fcac203af`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:20:37,441::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:20:37,441::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:20:37,442::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:20:37,442::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:20:37,442::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:20:37,442::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:20:37,442::task::993::Storage.TaskManager.Task::(_decref) Task=`f52f7f06-c74c-421d-abad-9d0fcac203af`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:20:38,238::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:20:38,250::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734816 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:38,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:38,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122395 s, 83.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:20:38,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:20:38,687::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635648 s, 6.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:20:38,690::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:20:38,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:38,690::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:20:38,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:38,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:38,691::__init__::225::IOProcess::(_processLogs) (14494) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:38,691::__init__::225::IOProcess::(_processLogs) (14494) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:38,691::__init__::225::IOProcess::(_processLogs) (14494) Building response >Thread-25::DEBUG::2014-08-12 15:20:38,691::__init__::225::IOProcess::(_processLogs) (14494) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:38,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:38,692::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:20:38,692::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:20:38,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:38,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:38,693::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:38,693::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:38,693::__init__::225::IOProcess::(_processLogs) (14495) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:38,693::__init__::225::IOProcess::(_processLogs) (14495) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:38,694::__init__::225::IOProcess::(_processLogs) (14495) Building response >Thread-25::DEBUG::2014-08-12 15:20:38,694::__init__::225::IOProcess::(_processLogs) (14495) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:38,694::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:38,694::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:39,345::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:39,346::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:39,347::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:40,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:40,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122977 s, 83.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:42,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:42,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120297 s, 85.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:44,353::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:44,354::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:44,359::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:44,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:44,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120751 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:46,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-08-12 15:20:46,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5af76d8-c60a-4dfa-be0f-2b24689ecc4d`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:46,861::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:20:46,863::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635648', 'lastCheck': '8.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734816', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:20:46,865::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5af76d8-c60a-4dfa-be0f-2b24689ecc4d`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635648', 'lastCheck': '8.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734816', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:20:46,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5af76d8-c60a-4dfa-be0f-2b24689ecc4d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:46,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:46,867::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:46,869::task::993::Storage.TaskManager.Task::(_decref) Task=`a5af76d8-c60a-4dfa-be0f-2b24689ecc4d`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:20:46,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309372 s, 33.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:20:46,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:20:47,474::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:20:47,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`aeff2ded-116f-47af-be55-4c690efd5955`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:47,475::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:20:47,510::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:47,510::task::1191::Storage.TaskManager.Task::(prepare) Task=`aeff2ded-116f-47af-be55-4c690efd5955`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:47,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`aeff2ded-116f-47af-be55-4c690efd5955`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:47,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:47,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:47,511::task::993::Storage.TaskManager.Task::(_decref) Task=`aeff2ded-116f-47af-be55-4c690efd5955`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:20:47,522::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:20:47,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7fb4c54-70ae-4fee-8049-9428c889910c`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:20:47,522::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:20:47,523::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`61aa42e4-944a-4cc2-a72e-2608b91eb2ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:20:47,523::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:20:47,523::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:20:47,523::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`61aa42e4-944a-4cc2-a72e-2608b91eb2ee`::Granted request >Thread-32::DEBUG::2014-08-12 15:20:47,524::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c7fb4c54-70ae-4fee-8049-9428c889910c`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:20:47,524::task::993::Storage.TaskManager.Task::(_decref) Task=`c7fb4c54-70ae-4fee-8049-9428c889910c`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:20:47,536::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:47,536::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7fb4c54-70ae-4fee-8049-9428c889910c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:47,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7fb4c54-70ae-4fee-8049-9428c889910c`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:20:47,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:20:47,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:20:47,537::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:20:47,537::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:20:47,537::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:20:47,537::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:20:47,538::task::993::Storage.TaskManager.Task::(_decref) Task=`c7fb4c54-70ae-4fee-8049-9428c889910c`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:20:48,251::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:20:48,263::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705812 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:20:48,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:20:48,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648873 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:20:48,710::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:20:48,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:48,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:20:48,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:48,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:48,711::__init__::225::IOProcess::(_processLogs) (14496) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:48,711::__init__::225::IOProcess::(_processLogs) (14496) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:48,711::__init__::225::IOProcess::(_processLogs) (14496) Building response >Thread-25::DEBUG::2014-08-12 15:20:48,711::__init__::225::IOProcess::(_processLogs) (14496) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:48,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:48,712::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:20:48,712::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:20:48,713::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:48,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:48,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:48,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:48,713::__init__::225::IOProcess::(_processLogs) (14497) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:48,714::__init__::225::IOProcess::(_processLogs) (14497) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:48,714::__init__::225::IOProcess::(_processLogs) (14497) Building response >Thread-25::DEBUG::2014-08-12 15:20:48,714::__init__::225::IOProcess::(_processLogs) (14497) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:48,714::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:48,714::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:20:48,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:49,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121917 s, 84.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:49,365::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:49,366::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:49,370::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:20:51,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:51,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120729 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:53,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:53,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120613 s, 84.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:54,374::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:54,375::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:54,394::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:20:54,973::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:20:55,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:55,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122033 s, 83.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:20:57,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:57,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121485 s, 84.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:20:57,554::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:20:57,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e6f2f9a-2f12-4b9e-9229-67efc9926e51`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:20:57,555::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:20:57,605::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:57,605::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e6f2f9a-2f12-4b9e-9229-67efc9926e51`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:20:57,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e6f2f9a-2f12-4b9e-9229-67efc9926e51`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:20:57,606::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:20:57,606::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:20:57,606::task::993::Storage.TaskManager.Task::(_decref) Task=`6e6f2f9a-2f12-4b9e-9229-67efc9926e51`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:20:57,618::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:20:57,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`af9c4c9f-b81d-4ac8-b1a8-533f828105e8`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:20:57,619::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:20:57,619::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`1f228c4a-ee5c-483c-be4d-f56bea25b123`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:20:57,619::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:20:57,620::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:20:57,620::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`1f228c4a-ee5c-483c-be4d-f56bea25b123`::Granted request >Thread-32::DEBUG::2014-08-12 15:20:57,620::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af9c4c9f-b81d-4ac8-b1a8-533f828105e8`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:20:57,620::task::993::Storage.TaskManager.Task::(_decref) Task=`af9c4c9f-b81d-4ac8-b1a8-533f828105e8`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:20:57,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:57,633::task::1191::Storage.TaskManager.Task::(prepare) Task=`af9c4c9f-b81d-4ac8-b1a8-533f828105e8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:20:57,633::task::595::Storage.TaskManager.Task::(_updateState) Task=`af9c4c9f-b81d-4ac8-b1a8-533f828105e8`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:20:57,633::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:20:57,634::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:20:57,634::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:20:57,634::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:20:57,634::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:20:57,634::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:20:57,635::task::993::Storage.TaskManager.Task::(_decref) Task=`af9c4c9f-b81d-4ac8-b1a8-533f828105e8`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:20:58,265::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:20:58,276::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704778 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:20:58,716::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:20:58,727::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626865 s, 6.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:20:58,731::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:20:58,731::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:20:58,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:58,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:58,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:58,732::__init__::225::IOProcess::(_processLogs) (14498) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:58,732::__init__::225::IOProcess::(_processLogs) (14498) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:58,732::__init__::225::IOProcess::(_processLogs) (14498) Building response >Thread-25::DEBUG::2014-08-12 15:20:58,732::__init__::225::IOProcess::(_processLogs) (14498) Queuing response >Thread-25::DEBUG::2014-08-12 15:20:58,732::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:58,732::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:20:58,733::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:20:58,734::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:20:58,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:20:58,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:20:58,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:20:58,734::__init__::225::IOProcess::(_processLogs) (14499) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:20:58,734::__init__::225::IOProcess::(_processLogs) (14499) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:20:58,734::__init__::225::IOProcess::(_processLogs) (14499) Building response >Thread-25::DEBUG::2014-08-12 15:20:58,735::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:20:58,735::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:20:59,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:20:59,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120655 s, 84.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:59,401::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:59,402::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:20:59,412::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:01,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:01,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01209 s, 84.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:21:02,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cffb4b5-17e0-41fd-b86a-d0fd8f27f4e5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:02,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:21:02,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626865', 'lastCheck': '3.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704778', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:21:02,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`1cffb4b5-17e0-41fd-b86a-d0fd8f27f4e5`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626865', 'lastCheck': '3.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704778', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:21:02,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cffb4b5-17e0-41fd-b86a-d0fd8f27f4e5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:02,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:02,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:02,064::task::993::Storage.TaskManager.Task::(_decref) Task=`1cffb4b5-17e0-41fd-b86a-d0fd8f27f4e5`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:21:02,085::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:03,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:03,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119687 s, 85.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:04,419::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:04,424::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:04,424::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:05,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:05,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120778 s, 84.8 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:21:06,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`12e81265-2040-41a4-a6c5-114efe7d99f8`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:21:06,452::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:21:06,453::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:21:06,453::task::1191::Storage.TaskManager.Task::(prepare) Task=`12e81265-2040-41a4-a6c5-114efe7d99f8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:21:06,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`12e81265-2040-41a4-a6c5-114efe7d99f8`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:21:06,453::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:21:06,453::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:21:06,453::task::993::Storage.TaskManager.Task::(_decref) Task=`12e81265-2040-41a4-a6c5-114efe7d99f8`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:21:06,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb57cb34-3d4b-4352-bcbb-3c7d39dab87c`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:21:06,454::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:21:06,454::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:21:06,454::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb57cb34-3d4b-4352-bcbb-3c7d39dab87c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:21:06,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb57cb34-3d4b-4352-bcbb-3c7d39dab87c`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:21:06,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:21:06,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:21:06,455::task::993::Storage.TaskManager.Task::(_decref) Task=`eb57cb34-3d4b-4352-bcbb-3c7d39dab87c`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:21:06,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac3ceca6-bb2b-47db-8dc4-3ad84b5e32a0`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:21:06,455::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:21:06,456::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:21:06,456::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac3ceca6-bb2b-47db-8dc4-3ad84b5e32a0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:21:06,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac3ceca6-bb2b-47db-8dc4-3ad84b5e32a0`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:21:06,456::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:21:06,456::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:21:06,457::task::993::Storage.TaskManager.Task::(_decref) Task=`ac3ceca6-bb2b-47db-8dc4-3ad84b5e32a0`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:21:06,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cbc2d59-3394-4041-9ddc-dd89636d82a7`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:21:06,457::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:21:06,457::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:21:06,457::task::1191::Storage.TaskManager.Task::(prepare) Task=`8cbc2d59-3394-4041-9ddc-dd89636d82a7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:21:06,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cbc2d59-3394-4041-9ddc-dd89636d82a7`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:21:06,458::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:21:06,458::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:21:06,458::task::993::Storage.TaskManager.Task::(_decref) Task=`8cbc2d59-3394-4041-9ddc-dd89636d82a7`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:21:07,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:07,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121952 s, 84.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:21:07,658::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:21:07,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`88102430-ee8b-4787-a85c-fad3ea666a3c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:07,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:21:07,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:07,675::task::1191::Storage.TaskManager.Task::(prepare) Task=`88102430-ee8b-4787-a85c-fad3ea666a3c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:07,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`88102430-ee8b-4787-a85c-fad3ea666a3c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:07,675::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:07,675::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:07,675::task::993::Storage.TaskManager.Task::(_decref) Task=`88102430-ee8b-4787-a85c-fad3ea666a3c`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:21:07,690::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:21:07,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`970609e2-3f84-4cce-9109-13927846e79f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:21:07,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:21:07,691::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`89c6f8ab-9d3c-4e56-9885-8e7476b32983`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:21:07,691::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:21:07,692::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:21:07,692::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`89c6f8ab-9d3c-4e56-9885-8e7476b32983`::Granted request >Thread-32::DEBUG::2014-08-12 15:21:07,692::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`970609e2-3f84-4cce-9109-13927846e79f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:21:07,692::task::993::Storage.TaskManager.Task::(_decref) Task=`970609e2-3f84-4cce-9109-13927846e79f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:21:07,705::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:07,705::task::1191::Storage.TaskManager.Task::(prepare) Task=`970609e2-3f84-4cce-9109-13927846e79f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:07,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`970609e2-3f84-4cce-9109-13927846e79f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:21:07,705::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:21:07,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:21:07,706::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:21:07,706::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:21:07,706::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:21:07,706::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:21:07,706::task::993::Storage.TaskManager.Task::(_decref) Task=`970609e2-3f84-4cce-9109-13927846e79f`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:21:08,278::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:21:08,289::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759931 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:21:08,736::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:21:08,747::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574476 s, 7.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:21:08,751::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:21:08,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:08,751::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:08,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:08,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:08,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:08,752::__init__::225::IOProcess::(_processLogs) (14500) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:08,752::__init__::225::IOProcess::(_processLogs) (14500) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:08,752::__init__::225::IOProcess::(_processLogs) (14500) Building response >Thread-25::DEBUG::2014-08-12 15:21:08,752::__init__::225::IOProcess::(_processLogs) (14500) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:08,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:08,752::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:21:08,753::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:21:08,753::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:21:08,753::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:08,754::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:08,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:08,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:08,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:08,754::__init__::225::IOProcess::(_processLogs) (14501) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:08,755::__init__::225::IOProcess::(_processLogs) (14501) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:08,755::__init__::225::IOProcess::(_processLogs) (14501) Building response >Thread-25::DEBUG::2014-08-12 15:21:08,755::__init__::225::IOProcess::(_processLogs) (14501) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:08,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:08,755::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:09,431::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:09,432::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:09,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:09,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:09,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120626 s, 84.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:11,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:11,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121409 s, 84.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:13,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:13,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121267 s, 84.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:14,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:14,461::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:14,471::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:15,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:15,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0192483 s, 53.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:21:17,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d76e688-c348-4af5-9828-dbc2e9df5b17`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:17,181::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:21:17,181::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574476', 'lastCheck': '8.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759931', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:21:17,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d76e688-c348-4af5-9828-dbc2e9df5b17`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574476', 'lastCheck': '8.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759931', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:21:17,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d76e688-c348-4af5-9828-dbc2e9df5b17`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:17,182::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:17,182::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:17,182::task::993::Storage.TaskManager.Task::(_decref) Task=`8d76e688-c348-4af5-9828-dbc2e9df5b17`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:21:17,217::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:21:17,723::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:21:17,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`77ef82df-7b25-4eb9-a0bd-687a07bf3dc7`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:17,724::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:21:17,761::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:17,761::task::1191::Storage.TaskManager.Task::(prepare) Task=`77ef82df-7b25-4eb9-a0bd-687a07bf3dc7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:17,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`77ef82df-7b25-4eb9-a0bd-687a07bf3dc7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:17,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:17,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:17,762::task::993::Storage.TaskManager.Task::(_decref) Task=`77ef82df-7b25-4eb9-a0bd-687a07bf3dc7`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:21:17,776::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:21:17,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`0dcde631-b488-4c8e-8a7b-6259239e5e00`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:21:17,776::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:21:17,777::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c0d59d23-f54f-4f32-86ae-5c78ba88b441`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:21:17,777::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:21:17,777::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:21:17,777::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c0d59d23-f54f-4f32-86ae-5c78ba88b441`::Granted request >Thread-32::DEBUG::2014-08-12 15:21:17,778::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0dcde631-b488-4c8e-8a7b-6259239e5e00`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:21:17,778::task::993::Storage.TaskManager.Task::(_decref) Task=`0dcde631-b488-4c8e-8a7b-6259239e5e00`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:21:17,790::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:17,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`0dcde631-b488-4c8e-8a7b-6259239e5e00`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:17,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`0dcde631-b488-4c8e-8a7b-6259239e5e00`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:21:17,791::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:21:17,791::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:21:17,791::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:21:17,792::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:21:17,792::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:21:17,792::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:21:17,792::task::993::Storage.TaskManager.Task::(_decref) Task=`0dcde631-b488-4c8e-8a7b-6259239e5e00`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:21:18,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:18,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121267 s, 84.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:21:18,291::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:21:18,303::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806316 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:21:18,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:21:18,768::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604415 s, 6.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:21:18,771::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:21:18,771::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:21:18,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:18,772::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:18,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:18,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:18,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:18,772::__init__::225::IOProcess::(_processLogs) (14502) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:18,772::__init__::225::IOProcess::(_processLogs) (14502) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:18,773::__init__::225::IOProcess::(_processLogs) (14502) Building response >Thread-25::DEBUG::2014-08-12 15:21:18,773::__init__::225::IOProcess::(_processLogs) (14502) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:18,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:18,773::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:21:18,774::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:21:18,774::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:21:18,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:18,774::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:18,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:18,775::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:18,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:18,775::__init__::225::IOProcess::(_processLogs) (14503) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:18,775::__init__::225::IOProcess::(_processLogs) (14503) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:18,775::__init__::225::IOProcess::(_processLogs) (14503) Building response >Thread-25::DEBUG::2014-08-12 15:21:18,776::__init__::225::IOProcess::(_processLogs) (14503) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:18,776::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:18,776::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:19,472::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:19,473::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:19,482::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:20,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:20,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121384 s, 84.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:22,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:22,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129816 s, 78.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:24,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:24,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130445 s, 78.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:24,489::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:24,490::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:24,500::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:21:25,009::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:21:26,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:26,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119495 s, 85.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:21:27,809::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:21:27,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`619be7a5-be57-4a97-a6da-dfc508fabd4f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:27,810::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:21:27,857::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:27,857::task::1191::Storage.TaskManager.Task::(prepare) Task=`619be7a5-be57-4a97-a6da-dfc508fabd4f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:27,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`619be7a5-be57-4a97-a6da-dfc508fabd4f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:27,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:27,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:27,858::task::993::Storage.TaskManager.Task::(_decref) Task=`619be7a5-be57-4a97-a6da-dfc508fabd4f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:21:27,875::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:21:27,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c1169c0-b333-49cf-bf39-87dd94c6dfc4`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:21:27,876::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:21:27,877::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`610efb95-2435-4b2e-a0c9-36ecfd4e7c45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:21:27,877::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:21:27,877::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:21:27,877::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`610efb95-2435-4b2e-a0c9-36ecfd4e7c45`::Granted request >Thread-32::DEBUG::2014-08-12 15:21:27,878::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c1169c0-b333-49cf-bf39-87dd94c6dfc4`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:21:27,878::task::993::Storage.TaskManager.Task::(_decref) Task=`6c1169c0-b333-49cf-bf39-87dd94c6dfc4`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:21:27,891::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:27,891::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c1169c0-b333-49cf-bf39-87dd94c6dfc4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:27,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c1169c0-b333-49cf-bf39-87dd94c6dfc4`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:21:27,891::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:21:27,891::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:21:27,891::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:21:27,892::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:21:27,892::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:21:27,892::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:21:27,892::task::993::Storage.TaskManager.Task::(_decref) Task=`6c1169c0-b333-49cf-bf39-87dd94c6dfc4`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:21:28,304::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:21:28,315::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675331 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:28,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:28,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121865 s, 84.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:21:28,778::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:21:28,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571443 s, 7.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:21:28,792::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:21:28,792::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:21:28,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:28,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:28,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:28,793::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:28,793::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:28,793::__init__::225::IOProcess::(_processLogs) (14504) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:28,794::__init__::225::IOProcess::(_processLogs) (14504) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:28,794::__init__::225::IOProcess::(_processLogs) (14504) Building response >Thread-25::DEBUG::2014-08-12 15:21:28,794::__init__::225::IOProcess::(_processLogs) (14504) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:28,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:28,794::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:21:28,795::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:21:28,795::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:21:28,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:28,796::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:28,796::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:28,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:28,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:28,796::__init__::225::IOProcess::(_processLogs) (14505) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:28,796::__init__::225::IOProcess::(_processLogs) (14505) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:28,797::__init__::225::IOProcess::(_processLogs) (14505) Building response >Thread-25::DEBUG::2014-08-12 15:21:28,797::__init__::225::IOProcess::(_processLogs) (14505) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:28,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:28,797::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:29,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:29,507::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:29,523::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:30,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:30,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121335 s, 84.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:21:32,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f2c0af1-e612-4af5-a63a-6ad38f34132c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:32,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:21:32,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571443', 'lastCheck': '3.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675331', 'lastCheck': '4.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:21:32,312::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f2c0af1-e612-4af5-a63a-6ad38f34132c`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571443', 'lastCheck': '3.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675331', 'lastCheck': '4.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:21:32,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f2c0af1-e612-4af5-a63a-6ad38f34132c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:32,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:32,313::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:32,313::task::993::Storage.TaskManager.Task::(_decref) Task=`6f2c0af1-e612-4af5-a63a-6ad38f34132c`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:21:32,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:32,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:32,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124688 s, 82.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:34,530::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:34,531::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:34,547::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:34,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:34,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122142 s, 83.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:36,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:36,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123229 s, 83.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:21:37,909::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [12e8aff0] >Thread-14::DEBUG::2014-08-12 15:21:37,909::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c1baf53-13cc-4e8b-837a-8e6d4d8314ea`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:37,910::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:21:37,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:37,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c1baf53-13cc-4e8b-837a-8e6d4d8314ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:37,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c1baf53-13cc-4e8b-837a-8e6d4d8314ea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:37,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:37,962::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:37,962::task::993::Storage.TaskManager.Task::(_decref) Task=`9c1baf53-13cc-4e8b-837a-8e6d4d8314ea`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:21:37,973::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [12e8aff0] >Thread-32::DEBUG::2014-08-12 15:21:37,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c29cf1b-6025-4f87-921d-35e825fcb562`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:21:37,974::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:21:37,974::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`7326b9dc-a9ee-48fd-8efe-87fd2157ee1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:21:37,975::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:21:37,975::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:21:37,975::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`7326b9dc-a9ee-48fd-8efe-87fd2157ee1e`::Granted request >Thread-32::DEBUG::2014-08-12 15:21:37,975::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c29cf1b-6025-4f87-921d-35e825fcb562`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:21:37,976::task::993::Storage.TaskManager.Task::(_decref) Task=`6c29cf1b-6025-4f87-921d-35e825fcb562`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:21:37,988::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:37,988::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c29cf1b-6025-4f87-921d-35e825fcb562`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:37,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c29cf1b-6025-4f87-921d-35e825fcb562`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:21:37,989::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:21:37,989::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:21:37,989::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:21:37,989::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:21:37,990::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:21:37,990::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:21:37,990::task::993::Storage.TaskManager.Task::(_decref) Task=`6c29cf1b-6025-4f87-921d-35e825fcb562`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:21:38,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:21:38,328::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830161 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:38,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:38,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012323 s, 83.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:21:38,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:21:38,832::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665485 s, 6.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:21:38,845::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:21:38,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:38,847::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:38,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:38,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:38,850::__init__::225::IOProcess::(_processLogs) (14506) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:38,851::__init__::225::IOProcess::(_processLogs) (14506) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:38,851::__init__::225::IOProcess::(_processLogs) (14506) Building response >Thread-25::DEBUG::2014-08-12 15:21:38,852::__init__::225::IOProcess::(_processLogs) (14506) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:38,853::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:38,854::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:21:38,857::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:21:38,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:38,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:38,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:38,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:38,861::__init__::225::IOProcess::(_processLogs) (14507) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:38,862::__init__::225::IOProcess::(_processLogs) (14507) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:38,862::__init__::225::IOProcess::(_processLogs) (14507) Building response >Thread-25::DEBUG::2014-08-12 15:21:38,863::__init__::225::IOProcess::(_processLogs) (14507) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:38,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:38,865::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:39,553::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:39,554::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:39,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:40,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:40,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124267 s, 82.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:42,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:43,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120827 s, 84.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:44,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:44,578::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:44,588::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:45,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:45,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133889 s, 76.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:47,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:47,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141831 s, 72.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:21:47,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c3e777a-58b2-4ed3-a4ac-a7ef86d9c022`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:47,433::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:21:47,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665485', 'lastCheck': '8.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830161', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:21:47,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c3e777a-58b2-4ed3-a4ac-a7ef86d9c022`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665485', 'lastCheck': '8.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000830161', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:21:47,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c3e777a-58b2-4ed3-a4ac-a7ef86d9c022`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:47,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:47,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:47,434::task::993::Storage.TaskManager.Task::(_decref) Task=`8c3e777a-58b2-4ed3-a4ac-a7ef86d9c022`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:21:47,461::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:21:48,004::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:21:48,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c14a095-782a-4e8b-8f3e-ba071b6fffa0`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:48,005::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:21:48,017::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:48,017::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c14a095-782a-4e8b-8f3e-ba071b6fffa0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:48,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c14a095-782a-4e8b-8f3e-ba071b6fffa0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:48,018::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:48,018::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:48,018::task::993::Storage.TaskManager.Task::(_decref) Task=`2c14a095-782a-4e8b-8f3e-ba071b6fffa0`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:21:48,031::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:21:48,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`23b2e617-da1d-438f-9fa8-d62b1610b928`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:21:48,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:21:48,032::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`fd1ba735-4def-4eec-b2fb-71a2b1331426`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:21:48,032::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:21:48,032::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:21:48,032::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`fd1ba735-4def-4eec-b2fb-71a2b1331426`::Granted request >Thread-32::DEBUG::2014-08-12 15:21:48,033::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`23b2e617-da1d-438f-9fa8-d62b1610b928`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:21:48,033::task::993::Storage.TaskManager.Task::(_decref) Task=`23b2e617-da1d-438f-9fa8-d62b1610b928`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:21:48,046::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:48,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`23b2e617-da1d-438f-9fa8-d62b1610b928`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:48,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`23b2e617-da1d-438f-9fa8-d62b1610b928`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:21:48,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:21:48,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:21:48,047::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:21:48,047::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:21:48,047::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:21:48,047::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:21:48,047::task::993::Storage.TaskManager.Task::(_decref) Task=`23b2e617-da1d-438f-9fa8-d62b1610b928`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:21:48,330::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:21:48,341::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696537 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:21:48,868::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:21:48,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682678 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:21:48,883::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:21:48,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:48,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:48,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:48,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:48,884::__init__::225::IOProcess::(_processLogs) (14508) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:48,884::__init__::225::IOProcess::(_processLogs) (14508) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:48,884::__init__::225::IOProcess::(_processLogs) (14508) Building response >Thread-25::DEBUG::2014-08-12 15:21:48,884::__init__::225::IOProcess::(_processLogs) (14508) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:48,884::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:21:48,885::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:21:48,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:21:48,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:48,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:48,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:48,886::__init__::225::IOProcess::(_processLogs) (14509) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:48,886::__init__::225::IOProcess::(_processLogs) (14509) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:48,886::__init__::225::IOProcess::(_processLogs) (14509) Building response >Thread-25::DEBUG::2014-08-12 15:21:48,887::__init__::225::IOProcess::(_processLogs) (14509) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:48,887::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-31::DEBUG::2014-08-12 15:21:49,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:49,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0165306 s, 61.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:49,594::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:49,595::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:49,605::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:21:51,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:51,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132109 s, 77.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:53,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:53,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131878 s, 77.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:54,612::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:54,613::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:54,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:21:55,043::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:21:55,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:55,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133914 s, 76.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:21:57,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:57,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129718 s, 78.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:21:58,065::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:21:58,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`2748d55d-2013-4c89-9b9b-6974f6db2a1f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:21:58,066::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:21:58,099::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:58,099::task::1191::Storage.TaskManager.Task::(prepare) Task=`2748d55d-2013-4c89-9b9b-6974f6db2a1f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:21:58,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`2748d55d-2013-4c89-9b9b-6974f6db2a1f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:21:58,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:21:58,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:21:58,100::task::993::Storage.TaskManager.Task::(_decref) Task=`2748d55d-2013-4c89-9b9b-6974f6db2a1f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:21:58,111::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:21:58,111::task::595::Storage.TaskManager.Task::(_updateState) Task=`bffa49a5-7951-4dcb-aa3a-053ba91ce2cc`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:21:58,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:21:58,112::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f3571699-8bda-4e91-b2f8-d83f3f250bfa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:21:58,112::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:21:58,113::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:21:58,113::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`f3571699-8bda-4e91-b2f8-d83f3f250bfa`::Granted request >Thread-32::DEBUG::2014-08-12 15:21:58,113::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bffa49a5-7951-4dcb-aa3a-053ba91ce2cc`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:21:58,113::task::993::Storage.TaskManager.Task::(_decref) Task=`bffa49a5-7951-4dcb-aa3a-053ba91ce2cc`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:21:58,126::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:58,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`bffa49a5-7951-4dcb-aa3a-053ba91ce2cc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:21:58,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`bffa49a5-7951-4dcb-aa3a-053ba91ce2cc`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:21:58,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:21:58,127::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:21:58,127::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:21:58,127::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:21:58,127::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:21:58,127::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:21:58,128::task::993::Storage.TaskManager.Task::(_decref) Task=`bffa49a5-7951-4dcb-aa3a-053ba91ce2cc`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:21:58,343::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:21:58,354::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00077343 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:21:58,888::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:21:58,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657777 s, 6.2 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:21:58,903::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:21:58,903::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:58,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:58,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:58,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:58,904::__init__::225::IOProcess::(_processLogs) (14510) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:58,904::__init__::225::IOProcess::(_processLogs) (14510) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:58,905::__init__::225::IOProcess::(_processLogs) (14510) Building response >Thread-25::DEBUG::2014-08-12 15:21:58,905::__init__::225::IOProcess::(_processLogs) (14510) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:58,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:58,905::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:21:58,906::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:21:58,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:21:58,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:21:58,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:21:58,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:21:58,907::__init__::225::IOProcess::(_processLogs) (14511) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:21:58,907::__init__::225::IOProcess::(_processLogs) (14511) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:21:58,908::__init__::225::IOProcess::(_processLogs) (14511) Building response >Thread-25::DEBUG::2014-08-12 15:21:58,908::__init__::225::IOProcess::(_processLogs) (14511) Queuing response >Thread-25::DEBUG::2014-08-12 15:21:58,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:21:58,908::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:21:59,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:21:59,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130396 s, 78.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:59,625::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:59,634::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:21:59,635::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:01,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:01,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130706 s, 78.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:02,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`8993ae60-00d4-4fff-8c1f-55f1924fec74`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:02,580::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:22:02,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657777', 'lastCheck': '3.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077343', 'lastCheck': '4.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:22:02,580::task::1191::Storage.TaskManager.Task::(prepare) Task=`8993ae60-00d4-4fff-8c1f-55f1924fec74`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657777', 'lastCheck': '3.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077343', 'lastCheck': '4.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:22:02,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`8993ae60-00d4-4fff-8c1f-55f1924fec74`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:02,581::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:02,581::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:02,581::task::993::Storage.TaskManager.Task::(_decref) Task=`8993ae60-00d4-4fff-8c1f-55f1924fec74`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:22:02,623::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:03,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:03,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133438 s, 76.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:04,641::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:04,642::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:04,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:05,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:05,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122308 s, 83.7 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:22:07,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`555e1ae5-3a64-4111-a744-6771f6abd180`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:22:07,382::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:22:07,382::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:22:07,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`555e1ae5-3a64-4111-a744-6771f6abd180`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:22:07,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`555e1ae5-3a64-4111-a744-6771f6abd180`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:22:07,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:22:07,383::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:22:07,383::task::993::Storage.TaskManager.Task::(_decref) Task=`555e1ae5-3a64-4111-a744-6771f6abd180`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:22:07,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e6e14ac-afed-4f5a-86f4-d79b0329b1e3`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:22:07,384::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:22:07,384::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:22:07,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e6e14ac-afed-4f5a-86f4-d79b0329b1e3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:22:07,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e6e14ac-afed-4f5a-86f4-d79b0329b1e3`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:22:07,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:22:07,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:22:07,385::task::993::Storage.TaskManager.Task::(_decref) Task=`1e6e14ac-afed-4f5a-86f4-d79b0329b1e3`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:22:07,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`75b73751-dec7-42cc-b6bc-d0f432666af3`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:22:07,385::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:22:07,386::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:22:07,386::task::1191::Storage.TaskManager.Task::(prepare) Task=`75b73751-dec7-42cc-b6bc-d0f432666af3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:22:07,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`75b73751-dec7-42cc-b6bc-d0f432666af3`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:22:07,386::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:22:07,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:22:07,386::task::993::Storage.TaskManager.Task::(_decref) Task=`75b73751-dec7-42cc-b6bc-d0f432666af3`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:22:07,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5472a8e-6518-4fa4-ad12-c88b98784c19`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:22:07,387::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:22:07,387::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:22:07,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5472a8e-6518-4fa4-ad12-c88b98784c19`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:22:07,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5472a8e-6518-4fa4-ad12-c88b98784c19`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:22:07,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:22:07,388::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:22:07,388::task::993::Storage.TaskManager.Task::(_decref) Task=`e5472a8e-6518-4fa4-ad12-c88b98784c19`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:22:07,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:07,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120149 s, 85.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:08,151::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:22:08,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`d54b4c2b-28df-44e5-b13c-f4f31c19e5ea`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:08,152::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:22:08,191::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:08,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`d54b4c2b-28df-44e5-b13c-f4f31c19e5ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:08,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`d54b4c2b-28df-44e5-b13c-f4f31c19e5ea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:08,192::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:08,192::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:08,192::task::993::Storage.TaskManager.Task::(_decref) Task=`d54b4c2b-28df-44e5-b13c-f4f31c19e5ea`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:22:08,203::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:22:08,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef5e49cd-5880-47dd-9f37-f7f3fce0d604`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:22:08,204::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:22:08,204::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`82744a0a-b805-4505-8f81-f9a22d70941a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:22:08,205::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:22:08,205::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:22:08,205::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`82744a0a-b805-4505-8f81-f9a22d70941a`::Granted request >Thread-32::DEBUG::2014-08-12 15:22:08,205::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ef5e49cd-5880-47dd-9f37-f7f3fce0d604`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:22:08,206::task::993::Storage.TaskManager.Task::(_decref) Task=`ef5e49cd-5880-47dd-9f37-f7f3fce0d604`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:22:08,218::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:08,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef5e49cd-5880-47dd-9f37-f7f3fce0d604`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:08,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef5e49cd-5880-47dd-9f37-f7f3fce0d604`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:22:08,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:22:08,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:22:08,219::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:22:08,219::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:22:08,220::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:22:08,220::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:22:08,220::task::993::Storage.TaskManager.Task::(_decref) Task=`ef5e49cd-5880-47dd-9f37-f7f3fce0d604`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:22:08,355::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:22:08,367::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700921 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:22:08,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:22:08,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061496 s, 6.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:22:08,925::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:22:08,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:08,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:08,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:08,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:08,926::__init__::225::IOProcess::(_processLogs) (14512) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:08,926::__init__::225::IOProcess::(_processLogs) (14512) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:08,926::__init__::225::IOProcess::(_processLogs) (14512) Building response >Thread-25::DEBUG::2014-08-12 15:22:08,926::__init__::225::IOProcess::(_processLogs) (14512) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:08,926::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:22:08,927::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:22:08,927::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:08,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:08,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:08,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:08,928::__init__::225::IOProcess::(_processLogs) (14513) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:08,928::__init__::225::IOProcess::(_processLogs) (14513) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:08,928::__init__::225::IOProcess::(_processLogs) (14513) Building response >Thread-25::DEBUG::2014-08-12 15:22:08,929::__init__::225::IOProcess::(_processLogs) (14513) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:08,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:08,929::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:09,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:09,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:09,675::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:09,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:09,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012121 s, 84.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:11,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:12,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119579 s, 85.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:14,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:14,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119198 s, 85.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:14,682::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:14,683::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:14,687::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:16,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:16,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179093 s, 57.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:17,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`746330be-fff5-4ce2-8429-19f615dc63a3`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:17,738::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:22:17,739::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061496', 'lastCheck': '8.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700921', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:22:17,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`746330be-fff5-4ce2-8429-19f615dc63a3`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061496', 'lastCheck': '8.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700921', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:22:17,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`746330be-fff5-4ce2-8429-19f615dc63a3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:17,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:17,739::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:17,740::task::993::Storage.TaskManager.Task::(_decref) Task=`746330be-fff5-4ce2-8429-19f615dc63a3`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:22:17,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:22:18,236::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:22:18,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f6584a6-ea91-4516-bada-107fe0b1f1ee`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:18,237::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:22:18,287::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:18,287::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f6584a6-ea91-4516-bada-107fe0b1f1ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:18,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f6584a6-ea91-4516-bada-107fe0b1f1ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:18,288::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:18,288::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:18,288::task::993::Storage.TaskManager.Task::(_decref) Task=`7f6584a6-ea91-4516-bada-107fe0b1f1ee`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:22:18,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-32::DEBUG::2014-08-12 15:22:18,311::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:22:18,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfa7352e-ea59-48ba-a792-2a71e705760f`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:22:18,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:22:18,313::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8856bbeb-c775-44d7-8d4f-01990db05272`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:22:18,313::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:22:18,313::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:22:18,314::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8856bbeb-c775-44d7-8d4f-01990db05272`::Granted request >Thread-32::DEBUG::2014-08-12 15:22:18,314::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cfa7352e-ea59-48ba-a792-2a71e705760f`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:22:18,314::task::993::Storage.TaskManager.Task::(_decref) Task=`cfa7352e-ea59-48ba-a792-2a71e705760f`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:22:18,361::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Dummy-31::DEBUG::2014-08-12 15:22:18,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123529 s, 82.9 MB/s\n'; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:22:18,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`cfa7352e-ea59-48ba-a792-2a71e705760f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:18,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfa7352e-ea59-48ba-a792-2a71e705760f`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:22:18,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:22:18,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:22:18,366::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:22:18,367::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:22:18,367::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:22:18,368::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-33::DEBUG::2014-08-12 15:22:18,371::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-32::DEBUG::2014-08-12 15:22:18,372::task::993::Storage.TaskManager.Task::(_decref) Task=`cfa7352e-ea59-48ba-a792-2a71e705760f`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:22:18,388::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575227 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:22:18,930::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:22:18,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645207 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:22:18,944::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:22:18,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:18,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:18,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:18,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:18,945::__init__::225::IOProcess::(_processLogs) (14514) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:18,945::__init__::225::IOProcess::(_processLogs) (14514) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:18,945::__init__::225::IOProcess::(_processLogs) (14514) Building response >Thread-25::DEBUG::2014-08-12 15:22:18,946::__init__::225::IOProcess::(_processLogs) (14514) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:18,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:18,946::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:22:18,947::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:22:18,947::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:18,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:18,947::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:18,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:18,948::__init__::225::IOProcess::(_processLogs) (14515) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:18,948::__init__::225::IOProcess::(_processLogs) (14515) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:18,948::__init__::225::IOProcess::(_processLogs) (14515) Building response >Thread-25::DEBUG::2014-08-12 15:22:18,948::__init__::225::IOProcess::(_processLogs) (14515) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:18,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:18,949::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:19,693::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:19,694::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:19,704::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:20,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:20,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011896 s, 86.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:22,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:22,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121541 s, 84.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:24,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:24,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118755 s, 86.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:24,711::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:24,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:24,728::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:22:25,085::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:22:26,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:26,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120093 s, 85.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:22:28,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:22:28,406::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616187 s, 6.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:28,412::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:22:28,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2f913b2-b3e7-4cec-b315-93603f5824ad`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:28,413::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:22:28,438::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:28,438::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2f913b2-b3e7-4cec-b315-93603f5824ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:28,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2f913b2-b3e7-4cec-b315-93603f5824ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:28,438::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:28,439::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:28,439::task::993::Storage.TaskManager.Task::(_decref) Task=`b2f913b2-b3e7-4cec-b315-93603f5824ad`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:22:28,451::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:22:28,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fa7944c-c16a-4793-85dc-7419ce0dab6b`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:22:28,452::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:22:28,452::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ef31472f-e876-4578-afb7-78060326dd0e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:22:28,453::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:22:28,453::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:22:28,453::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ef31472f-e876-4578-afb7-78060326dd0e`::Granted request >Thread-32::DEBUG::2014-08-12 15:22:28,453::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9fa7944c-c16a-4793-85dc-7419ce0dab6b`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:22:28,454::task::993::Storage.TaskManager.Task::(_decref) Task=`9fa7944c-c16a-4793-85dc-7419ce0dab6b`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:22:28,466::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:28,466::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fa7944c-c16a-4793-85dc-7419ce0dab6b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:28,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fa7944c-c16a-4793-85dc-7419ce0dab6b`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:22:28,466::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:22:28,467::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:22:28,467::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:22:28,467::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:22:28,467::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:22:28,467::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:22:28,468::task::993::Storage.TaskManager.Task::(_decref) Task=`9fa7944c-c16a-4793-85dc-7419ce0dab6b`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:22:28,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:28,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121034 s, 84.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:22:28,950::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:22:28,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669414 s, 6.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:22:28,966::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:22:28,966::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:22:28,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:28,966::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:28,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:28,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:28,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:28,967::__init__::225::IOProcess::(_processLogs) (14516) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:28,967::__init__::225::IOProcess::(_processLogs) (14516) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:28,967::__init__::225::IOProcess::(_processLogs) (14516) Building response >Thread-25::DEBUG::2014-08-12 15:22:28,967::__init__::225::IOProcess::(_processLogs) (14516) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:28,967::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:28,968::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:22:28,968::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:22:28,969::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:22:28,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:28,969::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:28,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:28,969::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:28,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:28,970::__init__::225::IOProcess::(_processLogs) (14517) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:28,970::__init__::225::IOProcess::(_processLogs) (14517) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:28,970::__init__::225::IOProcess::(_processLogs) (14517) Building response >Thread-25::DEBUG::2014-08-12 15:22:28,970::__init__::225::IOProcess::(_processLogs) (14517) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:28,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:28,970::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:29,734::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:29,735::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:29,739::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:30,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:30,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132243 s, 77.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:32,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-14::DEBUG::2014-08-12 15:22:32,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f1b8dce-1e69-448a-a5c3-a2d69dcc6f24`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:32,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:22:32,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669414', 'lastCheck': '3.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616187', 'lastCheck': '4.5', 'valid': True}} >Dummy-31::DEBUG::2014-08-12 15:22:32,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0178876 s, 57.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:32,904::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f1b8dce-1e69-448a-a5c3-a2d69dcc6f24`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669414', 'lastCheck': '3.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616187', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:22:32,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f1b8dce-1e69-448a-a5c3-a2d69dcc6f24`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:32,905::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:32,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:32,906::task::993::Storage.TaskManager.Task::(_decref) Task=`3f1b8dce-1e69-448a-a5c3-a2d69dcc6f24`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:22:32,939::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:34,746::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:34,747::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:34,763::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:34,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:34,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122281 s, 83.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:37,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:37,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120545 s, 84.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:22:38,408::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:22:38,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734566 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:38,487::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:22:38,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f5a88b5-4720-4271-89d6-f83a17bbac4d`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:38,488::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:22:38,522::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:38,522::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f5a88b5-4720-4271-89d6-f83a17bbac4d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:38,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f5a88b5-4720-4271-89d6-f83a17bbac4d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:38,522::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:38,522::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:38,523::task::993::Storage.TaskManager.Task::(_decref) Task=`3f5a88b5-4720-4271-89d6-f83a17bbac4d`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:22:38,533::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:22:38,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f087dcb-2654-4f4c-a2a4-d46d3c8e2047`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:22:38,534::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:22:38,536::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`81b34e1c-f414-4d45-bcfc-a2bd1c61e7d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:22:38,536::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:22:38,537::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:22:38,537::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`81b34e1c-f414-4d45-bcfc-a2bd1c61e7d4`::Granted request >Thread-32::DEBUG::2014-08-12 15:22:38,537::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3f087dcb-2654-4f4c-a2a4-d46d3c8e2047`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:22:38,537::task::993::Storage.TaskManager.Task::(_decref) Task=`3f087dcb-2654-4f4c-a2a4-d46d3c8e2047`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:22:38,549::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:38,550::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f087dcb-2654-4f4c-a2a4-d46d3c8e2047`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:38,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f087dcb-2654-4f4c-a2a4-d46d3c8e2047`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:22:38,550::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:22:38,550::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:22:38,550::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:22:38,551::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:22:38,551::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:22:38,551::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:22:38,551::task::993::Storage.TaskManager.Task::(_decref) Task=`3f087dcb-2654-4f4c-a2a4-d46d3c8e2047`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:22:38,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:22:38,983::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652805 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:22:38,986::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:22:38,986::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:22:38,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:38,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:38,987::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:38,987::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:38,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:38,987::__init__::225::IOProcess::(_processLogs) (14518) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:38,987::__init__::225::IOProcess::(_processLogs) (14518) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:38,988::__init__::225::IOProcess::(_processLogs) (14518) Building response >Thread-25::DEBUG::2014-08-12 15:22:38,988::__init__::225::IOProcess::(_processLogs) (14518) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:38,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:38,988::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:22:38,989::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:22:38,989::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:22:38,989::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:38,989::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:38,989::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:38,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:38,990::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:38,990::__init__::225::IOProcess::(_processLogs) (14519) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:38,990::__init__::225::IOProcess::(_processLogs) (14519) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:38,990::__init__::225::IOProcess::(_processLogs) (14519) Building response >Thread-25::DEBUG::2014-08-12 15:22:38,990::__init__::225::IOProcess::(_processLogs) (14519) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:38,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:38,991::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:22:39,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:39,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122025 s, 83.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:39,770::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:39,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:39,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:41,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:41,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120941 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:43,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:43,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284088 s, 36.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:44,799::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:44,800::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:44,804::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:45,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:45,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122934 s, 83.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:47,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:47,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122016 s, 83.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:48,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`887e0dd0-4a51-48ba-b671-927e5a118354`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:48,054::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:22:48,054::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652805', 'lastCheck': '9.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734566', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:22:48,055::task::1191::Storage.TaskManager.Task::(prepare) Task=`887e0dd0-4a51-48ba-b671-927e5a118354`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652805', 'lastCheck': '9.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734566', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:22:48,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`887e0dd0-4a51-48ba-b671-927e5a118354`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:48,055::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:48,055::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:48,055::task::993::Storage.TaskManager.Task::(_decref) Task=`887e0dd0-4a51-48ba-b671-927e5a118354`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:22:48,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-33::DEBUG::2014-08-12 15:22:48,421::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:22:48,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641664 s, 6.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:48,566::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:22:48,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`48e446e7-ec6c-4fa5-bc1e-da8bdbf94803`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:48,567::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:22:48,579::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:48,579::task::1191::Storage.TaskManager.Task::(prepare) Task=`48e446e7-ec6c-4fa5-bc1e-da8bdbf94803`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:48,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`48e446e7-ec6c-4fa5-bc1e-da8bdbf94803`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:48,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:48,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:48,579::task::993::Storage.TaskManager.Task::(_decref) Task=`48e446e7-ec6c-4fa5-bc1e-da8bdbf94803`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:22:48,590::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:22:48,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba76c6ba-7aae-4115-8fdf-84ce9e4a8436`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:22:48,590::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:22:48,591::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`e842b3b9-aaca-4dc9-8693-0efb463b114e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:22:48,591::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:22:48,592::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:22:48,592::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`e842b3b9-aaca-4dc9-8693-0efb463b114e`::Granted request >Thread-32::DEBUG::2014-08-12 15:22:48,592::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ba76c6ba-7aae-4115-8fdf-84ce9e4a8436`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:22:48,592::task::993::Storage.TaskManager.Task::(_decref) Task=`ba76c6ba-7aae-4115-8fdf-84ce9e4a8436`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:22:48,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:48,605::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba76c6ba-7aae-4115-8fdf-84ce9e4a8436`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:48,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba76c6ba-7aae-4115-8fdf-84ce9e4a8436`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:22:48,605::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:22:48,605::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:22:48,606::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:22:48,606::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:22:48,606::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:22:48,606::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:22:48,607::task::993::Storage.TaskManager.Task::(_decref) Task=`ba76c6ba-7aae-4115-8fdf-84ce9e4a8436`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:22:48,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:22:49,003::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600258 s, 6.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:22:49,006::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:22:49,007::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:22:49,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:49,007::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:49,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:49,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:49,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:49,008::__init__::225::IOProcess::(_processLogs) (14520) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:49,008::__init__::225::IOProcess::(_processLogs) (14520) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:49,008::__init__::225::IOProcess::(_processLogs) (14520) Building response >Thread-25::DEBUG::2014-08-12 15:22:49,008::__init__::225::IOProcess::(_processLogs) (14520) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:49,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:49,008::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:22:49,009::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:22:49,009::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:22:49,009::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:49,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:49,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:49,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:49,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:49,010::__init__::225::IOProcess::(_processLogs) (14521) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:49,010::__init__::225::IOProcess::(_processLogs) (14521) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:49,011::__init__::225::IOProcess::(_processLogs) (14521) Building response >Thread-25::DEBUG::2014-08-12 15:22:49,011::__init__::225::IOProcess::(_processLogs) (14521) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:49,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:49,011::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:22:49,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:49,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121599 s, 84.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:49,811::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:49,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:49,822::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:51,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:51,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121576 s, 84.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:53,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:53,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132175 s, 77.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:54,828::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:54,829::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:54,845::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:22:55,149::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:22:55,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:55,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134263 s, 76.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:22:57,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:22:57,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126283 s, 81.1 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:22:58,434::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:22:58,445::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000723665 s, 5.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:22:58,630::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:22:58,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`b558dc3b-639e-4a60-b894-44eec829edad`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:22:58,631::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:22:58,672::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:58,672::task::1191::Storage.TaskManager.Task::(prepare) Task=`b558dc3b-639e-4a60-b894-44eec829edad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:22:58,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`b558dc3b-639e-4a60-b894-44eec829edad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:22:58,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:22:58,673::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:22:58,673::task::993::Storage.TaskManager.Task::(_decref) Task=`b558dc3b-639e-4a60-b894-44eec829edad`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:22:58,686::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:22:58,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5cde43a-ad9e-4861-9eb6-b463ef024fd2`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:22:58,686::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:22:58,687::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`76ad22dc-8fc6-46f2-a652-ac82a1b7f369`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:22:58,687::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:22:58,687::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:22:58,687::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`76ad22dc-8fc6-46f2-a652-ac82a1b7f369`::Granted request >Thread-32::DEBUG::2014-08-12 15:22:58,688::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d5cde43a-ad9e-4861-9eb6-b463ef024fd2`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:22:58,688::task::993::Storage.TaskManager.Task::(_decref) Task=`d5cde43a-ad9e-4861-9eb6-b463ef024fd2`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:22:58,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:58,703::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5cde43a-ad9e-4861-9eb6-b463ef024fd2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:22:58,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5cde43a-ad9e-4861-9eb6-b463ef024fd2`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:22:58,703::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:22:58,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:22:58,703::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:22:58,704::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:22:58,704::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:22:58,704::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:22:58,704::task::993::Storage.TaskManager.Task::(_decref) Task=`d5cde43a-ad9e-4861-9eb6-b463ef024fd2`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:22:59,013::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:22:59,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000744775 s, 5.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:22:59,027::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:22:59,027::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:22:59,027::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:59,027::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:59,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:59,028::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:59,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:59,028::__init__::225::IOProcess::(_processLogs) (14522) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:59,028::__init__::225::IOProcess::(_processLogs) (14522) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:59,028::__init__::225::IOProcess::(_processLogs) (14522) Building response >Thread-25::DEBUG::2014-08-12 15:22:59,029::__init__::225::IOProcess::(_processLogs) (14522) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:59,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:59,029::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:22:59,030::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:22:59,030::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:22:59,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:22:59,030::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:22:59,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:22:59,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:22:59,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:22:59,031::__init__::225::IOProcess::(_processLogs) (14523) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:22:59,031::__init__::225::IOProcess::(_processLogs) (14523) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:22:59,031::__init__::225::IOProcess::(_processLogs) (14523) Building response >Thread-25::DEBUG::2014-08-12 15:22:59,031::__init__::225::IOProcess::(_processLogs) (14523) Queuing response >Thread-25::DEBUG::2014-08-12 15:22:59,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:22:59,031::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:59,852::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:59,852::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:22:59,863::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:22:59,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:00,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122144 s, 83.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:02,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:02,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120777 s, 84.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:03,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`7145c2f3-1675-4c8a-bfd4-f8654ecdf3c4`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:03,176::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:23:03,176::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744775', 'lastCheck': '4.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723665', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:23:03,177::task::1191::Storage.TaskManager.Task::(prepare) Task=`7145c2f3-1675-4c8a-bfd4-f8654ecdf3c4`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744775', 'lastCheck': '4.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723665', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:23:03,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`7145c2f3-1675-4c8a-bfd4-f8654ecdf3c4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:03,177::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:03,177::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:03,177::task::993::Storage.TaskManager.Task::(_decref) Task=`7145c2f3-1675-4c8a-bfd4-f8654ecdf3c4`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:23:03,199::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:04,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:04,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120871 s, 84.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:04,869::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:04,870::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:04,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:06,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:06,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121744 s, 84.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:08,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:08,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.011962 s, 85.6 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:23:08,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`6168ee63-a19a-40aa-881a-14cc793b2e37`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:23:08,310::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:23:08,311::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:23:08,311::task::1191::Storage.TaskManager.Task::(prepare) Task=`6168ee63-a19a-40aa-881a-14cc793b2e37`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:23:08,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`6168ee63-a19a-40aa-881a-14cc793b2e37`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:23:08,312::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:23:08,312::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:23:08,312::task::993::Storage.TaskManager.Task::(_decref) Task=`6168ee63-a19a-40aa-881a-14cc793b2e37`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:23:08,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e66cae9-ce44-426c-8f43-b55deb0f517a`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:23:08,313::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:23:08,313::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:23:08,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e66cae9-ce44-426c-8f43-b55deb0f517a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:23:08,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e66cae9-ce44-426c-8f43-b55deb0f517a`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:23:08,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:23:08,313::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:23:08,314::task::993::Storage.TaskManager.Task::(_decref) Task=`1e66cae9-ce44-426c-8f43-b55deb0f517a`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:23:08,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c5da50d-6c1b-42d2-9fd4-a00ce2d19259`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:23:08,314::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID='7bc4d940-6844-4473-aded-d04d3afc89f7', options=None) >Thread-44::INFO::2014-08-12 15:23:08,314::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:23:08,315::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c5da50d-6c1b-42d2-9fd4-a00ce2d19259`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:23:08,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c5da50d-6c1b-42d2-9fd4-a00ce2d19259`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:23:08,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:23:08,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:23:08,315::task::993::Storage.TaskManager.Task::(_decref) Task=`2c5da50d-6c1b-42d2-9fd4-a00ce2d19259`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:23:08,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`058f8501-1391-45df-b850-c82e5fa91ce9`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:23:08,316::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d', options=None) >Thread-44::INFO::2014-08-12 15:23:08,316::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:23:08,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`058f8501-1391-45df-b850-c82e5fa91ce9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:23:08,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`058f8501-1391-45df-b850-c82e5fa91ce9`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:23:08,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:23:08,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:23:08,317::task::993::Storage.TaskManager.Task::(_decref) Task=`058f8501-1391-45df-b850-c82e5fa91ce9`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:23:08,447::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:23:08,458::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629866 s, 6.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:08,721::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:23:08,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b2fc08a-1741-403e-9f93-67018aaf11ea`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:08,722::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:23:08,751::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:08,752::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b2fc08a-1741-403e-9f93-67018aaf11ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:08,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b2fc08a-1741-403e-9f93-67018aaf11ea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:08,752::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:08,752::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:08,752::task::993::Storage.TaskManager.Task::(_decref) Task=`8b2fc08a-1741-403e-9f93-67018aaf11ea`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:23:08,764::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:23:08,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`26013ede-2a2f-4c23-9914-acb47f445e23`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:23:08,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:23:08,765::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`b9737560-8eed-4b16-b28e-2c7722e485b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:23:08,765::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:23:08,765::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:23:08,766::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`b9737560-8eed-4b16-b28e-2c7722e485b2`::Granted request >Thread-32::DEBUG::2014-08-12 15:23:08,766::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`26013ede-2a2f-4c23-9914-acb47f445e23`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:23:08,766::task::993::Storage.TaskManager.Task::(_decref) Task=`26013ede-2a2f-4c23-9914-acb47f445e23`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:23:08,779::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:08,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`26013ede-2a2f-4c23-9914-acb47f445e23`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:08,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`26013ede-2a2f-4c23-9914-acb47f445e23`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:23:08,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:23:08,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:23:08,780::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:23:08,780::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:23:08,780::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:23:08,780::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:23:08,780::task::993::Storage.TaskManager.Task::(_decref) Task=`26013ede-2a2f-4c23-9914-acb47f445e23`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:23:09,033::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:23:09,046::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588149 s, 7.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:23:09,049::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:09,049::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:23:09,049::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:09,049::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:09,049::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:09,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:09,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:09,050::__init__::225::IOProcess::(_processLogs) (14524) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:09,050::__init__::225::IOProcess::(_processLogs) (14524) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:09,050::__init__::225::IOProcess::(_processLogs) (14524) Building response >Thread-25::DEBUG::2014-08-12 15:23:09,050::__init__::225::IOProcess::(_processLogs) (14524) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:09,051::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:09,051::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:23:09,051::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:09,052::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:23:09,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:09,052::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:09,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:09,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:09,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:09,053::__init__::225::IOProcess::(_processLogs) (14525) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:09,053::__init__::225::IOProcess::(_processLogs) (14525) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:09,053::__init__::225::IOProcess::(_processLogs) (14525) Building response >Thread-25::DEBUG::2014-08-12 15:23:09,053::__init__::225::IOProcess::(_processLogs) (14525) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:09,053::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:09,053::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:09,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:09,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:09,904::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:10,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:10,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122896 s, 83.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:12,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:12,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119906 s, 85.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:14,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:14,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121074 s, 84.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:14,906::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:14,907::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:14,915::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:16,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:16,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0197877 s, 51.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:18,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`56a3009b-9789-49c3-91d8-50459ea013b9`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:18,296::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:23:18,296::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588149', 'lastCheck': '9.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629866', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:23:18,297::task::1191::Storage.TaskManager.Task::(prepare) Task=`56a3009b-9789-49c3-91d8-50459ea013b9`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588149', 'lastCheck': '9.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629866', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:23:18,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`56a3009b-9789-49c3-91d8-50459ea013b9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:18,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:18,297::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:18,297::task::993::Storage.TaskManager.Task::(_decref) Task=`56a3009b-9789-49c3-91d8-50459ea013b9`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:23:18,322::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-33::DEBUG::2014-08-12 15:23:18,460::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:23:18,472::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624926 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:18,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:18,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129857 s, 78.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:18,826::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:23:18,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a63a0a3-6eb3-469c-9cf8-49eaafb2abb5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:18,829::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:23:18,864::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:18,864::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a63a0a3-6eb3-469c-9cf8-49eaafb2abb5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:18,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a63a0a3-6eb3-469c-9cf8-49eaafb2abb5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:18,865::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:18,865::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:18,865::task::993::Storage.TaskManager.Task::(_decref) Task=`1a63a0a3-6eb3-469c-9cf8-49eaafb2abb5`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:23:18,877::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:23:18,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`0dcb1eec-6f8d-4b2f-86d1-e837c411a418`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:23:18,877::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:23:18,878::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9e905993-6b25-4c0a-a2c5-353c3618d63a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:23:18,878::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:23:18,878::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:23:18,879::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9e905993-6b25-4c0a-a2c5-353c3618d63a`::Granted request >Thread-32::DEBUG::2014-08-12 15:23:18,879::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0dcb1eec-6f8d-4b2f-86d1-e837c411a418`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:23:18,879::task::993::Storage.TaskManager.Task::(_decref) Task=`0dcb1eec-6f8d-4b2f-86d1-e837c411a418`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:23:18,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:18,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`0dcb1eec-6f8d-4b2f-86d1-e837c411a418`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:18,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`0dcb1eec-6f8d-4b2f-86d1-e837c411a418`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:23:18,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:23:18,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:23:18,893::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:23:18,893::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:23:18,893::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:23:18,893::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:23:18,894::task::993::Storage.TaskManager.Task::(_decref) Task=`0dcb1eec-6f8d-4b2f-86d1-e837c411a418`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:23:19,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:23:19,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000549096 s, 7.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:23:19,070::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:19,070::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:23:19,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:19,070::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:19,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:19,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:19,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:19,071::__init__::225::IOProcess::(_processLogs) (14526) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:19,071::__init__::225::IOProcess::(_processLogs) (14526) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:19,071::__init__::225::IOProcess::(_processLogs) (14526) Building response >Thread-25::DEBUG::2014-08-12 15:23:19,071::__init__::225::IOProcess::(_processLogs) (14526) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:19,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:19,072::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:23:19,072::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:19,073::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:23:19,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:19,073::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:19,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:19,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:19,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:19,074::__init__::225::IOProcess::(_processLogs) (14527) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:19,074::__init__::225::IOProcess::(_processLogs) (14527) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:19,074::__init__::225::IOProcess::(_processLogs) (14527) Building response >Thread-25::DEBUG::2014-08-12 15:23:19,074::__init__::225::IOProcess::(_processLogs) (14527) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:19,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:19,074::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:19,922::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:19,923::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:19,927::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:20,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:20,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132179 s, 77.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:22,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:22,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150486 s, 68.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:24,934::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:24,935::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:24,957::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:24,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:25,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120672 s, 84.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:23:25,183::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:23:27,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:27,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120023 s, 85.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:23:28,474::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:23:28,486::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0012906 s, 3.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:28,912::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:23:28,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aadab83-f7f5-4680-8bbc-76a33958ba66`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:28,913::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:23:28,925::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:28,925::task::1191::Storage.TaskManager.Task::(prepare) Task=`0aadab83-f7f5-4680-8bbc-76a33958ba66`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:28,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aadab83-f7f5-4680-8bbc-76a33958ba66`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:28,926::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:28,926::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:28,926::task::993::Storage.TaskManager.Task::(_decref) Task=`0aadab83-f7f5-4680-8bbc-76a33958ba66`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:23:28,949::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:23:28,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`98097f37-7b72-4f5b-9aa3-2f528042abd7`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:23:28,949::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:23:28,950::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c16ceb1f-8f2f-4691-8541-76e85748c9ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:23:28,950::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:23:28,950::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:23:28,950::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c16ceb1f-8f2f-4691-8541-76e85748c9ae`::Granted request >Thread-32::DEBUG::2014-08-12 15:23:28,951::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`98097f37-7b72-4f5b-9aa3-2f528042abd7`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:23:28,951::task::993::Storage.TaskManager.Task::(_decref) Task=`98097f37-7b72-4f5b-9aa3-2f528042abd7`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:23:28,963::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:28,963::task::1191::Storage.TaskManager.Task::(prepare) Task=`98097f37-7b72-4f5b-9aa3-2f528042abd7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:28,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`98097f37-7b72-4f5b-9aa3-2f528042abd7`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:23:28,964::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:23:28,964::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:23:28,964::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:23:28,964::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:23:28,965::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:23:28,965::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:23:28,965::task::993::Storage.TaskManager.Task::(_decref) Task=`98097f37-7b72-4f5b-9aa3-2f528042abd7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:23:29,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:23:29,087::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739187 s, 5.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:23:29,090::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:29,091::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:23:29,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:29,091::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:29,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:29,091::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:29,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:29,092::__init__::225::IOProcess::(_processLogs) (14528) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:29,092::__init__::225::IOProcess::(_processLogs) (14528) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:29,092::__init__::225::IOProcess::(_processLogs) (14528) Building response >Thread-25::DEBUG::2014-08-12 15:23:29,092::__init__::225::IOProcess::(_processLogs) (14528) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:29,092::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:29,092::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:23:29,093::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:29,093::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:23:29,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:29,094::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:29,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:29,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:29,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:29,094::__init__::225::IOProcess::(_processLogs) (14529) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:29,095::__init__::225::IOProcess::(_processLogs) (14529) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:29,095::__init__::225::IOProcess::(_processLogs) (14529) Building response >Thread-25::DEBUG::2014-08-12 15:23:29,095::__init__::225::IOProcess::(_processLogs) (14529) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:29,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:29,095::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:23:29,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:29,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120162 s, 85.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:29,963::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:29,964::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:29,974::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:31,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:31,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120709 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:33,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:33,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119174 s, 85.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:33,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1f7681c-8fbd-43aa-a897-027138958cc4`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:33,433::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:23:33,433::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739187', 'lastCheck': '4.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012906', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:23:33,433::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1f7681c-8fbd-43aa-a897-027138958cc4`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739187', 'lastCheck': '4.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012906', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:23:33,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1f7681c-8fbd-43aa-a897-027138958cc4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:33,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:33,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:33,434::task::993::Storage.TaskManager.Task::(_decref) Task=`e1f7681c-8fbd-43aa-a897-027138958cc4`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:23:33,479::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:34,981::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:34,982::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:34,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:35,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:35,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122183 s, 83.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:37,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:37,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120414 s, 85.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:23:38,487::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:23:38,499::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678104 s, 6.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:38,984::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:23:38,985::task::595::Storage.TaskManager.Task::(_updateState) Task=`587bb87a-4ac3-4861-be80-615bc453c2a5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:38,985::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:23:39,024::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:39,025::task::1191::Storage.TaskManager.Task::(prepare) Task=`587bb87a-4ac3-4861-be80-615bc453c2a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:39,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`587bb87a-4ac3-4861-be80-615bc453c2a5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:39,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:39,025::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:39,026::task::993::Storage.TaskManager.Task::(_decref) Task=`587bb87a-4ac3-4861-be80-615bc453c2a5`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:23:39,038::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:23:39,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2c64623-7166-44b3-b1be-c0168bb72019`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:23:39,039::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:23:39,041::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`1a63c9b2-8926-4ae4-9b19-e0fb4f0026b3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:23:39,042::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:23:39,042::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:23:39,042::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`1a63c9b2-8926-4ae4-9b19-e0fb4f0026b3`::Granted request >Thread-32::DEBUG::2014-08-12 15:23:39,043::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f2c64623-7166-44b3-b1be-c0168bb72019`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:23:39,043::task::993::Storage.TaskManager.Task::(_decref) Task=`f2c64623-7166-44b3-b1be-c0168bb72019`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:23:39,055::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:39,055::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2c64623-7166-44b3-b1be-c0168bb72019`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:39,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2c64623-7166-44b3-b1be-c0168bb72019`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:23:39,056::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:23:39,056::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:23:39,056::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:23:39,057::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:23:39,057::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:23:39,057::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:23:39,057::task::993::Storage.TaskManager.Task::(_decref) Task=`f2c64623-7166-44b3-b1be-c0168bb72019`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:23:39,097::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:23:39,109::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713467 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:23:39,112::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:39,112::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:23:39,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:39,112::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:39,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:39,113::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:39,113::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:39,113::__init__::225::IOProcess::(_processLogs) (14530) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:39,113::__init__::225::IOProcess::(_processLogs) (14530) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:39,113::__init__::225::IOProcess::(_processLogs) (14530) Building response >Thread-25::DEBUG::2014-08-12 15:23:39,113::__init__::225::IOProcess::(_processLogs) (14530) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:39,114::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:39,114::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:23:39,115::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:39,115::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:23:39,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:39,115::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:39,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:39,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:39,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:39,116::__init__::225::IOProcess::(_processLogs) (14531) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:39,116::__init__::225::IOProcess::(_processLogs) (14531) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:39,116::__init__::225::IOProcess::(_processLogs) (14531) Building response >Thread-25::DEBUG::2014-08-12 15:23:39,116::__init__::225::IOProcess::(_processLogs) (14531) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:39,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:39,116::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:23:39,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:39,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012927 s, 79.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:40,000::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:40,001::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:40,010::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:41,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:41,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130829 s, 78.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:43,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:43,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132921 s, 77.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:45,016::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:45,017::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:45,027::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:45,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:45,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013097 s, 78.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:47,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:47,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131933 s, 77.6 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:23:48,501::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:23:48,512::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690099 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:48,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc389a42-3837-4cf5-b65a-e107813666b6`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:48,631::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:23:48,632::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713467', 'lastCheck': '9.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690099', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:23:48,632::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc389a42-3837-4cf5-b65a-e107813666b6`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713467', 'lastCheck': '9.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690099', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:23:48,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc389a42-3837-4cf5-b65a-e107813666b6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:48,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:48,632::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:48,633::task::993::Storage.TaskManager.Task::(_decref) Task=`fc389a42-3837-4cf5-b65a-e107813666b6`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:23:48,656::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:23:49,073::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:23:49,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7668e2c-38e8-44ad-9139-75a7346479eb`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:49,073::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:23:49,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:49,086::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7668e2c-38e8-44ad-9139-75a7346479eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:49,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7668e2c-38e8-44ad-9139-75a7346479eb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:49,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:49,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:49,086::task::993::Storage.TaskManager.Task::(_decref) Task=`c7668e2c-38e8-44ad-9139-75a7346479eb`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:23:49,098::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:23:49,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c00c5e2-e5de-4a67-8dfd-8b57c0473056`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:23:49,099::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:23:49,099::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`035aaa18-d548-4cf5-a1eb-7916a0665f29`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:23:49,099::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:23:49,100::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:23:49,100::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`035aaa18-d548-4cf5-a1eb-7916a0665f29`::Granted request >Thread-32::DEBUG::2014-08-12 15:23:49,100::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0c00c5e2-e5de-4a67-8dfd-8b57c0473056`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:23:49,100::task::993::Storage.TaskManager.Task::(_decref) Task=`0c00c5e2-e5de-4a67-8dfd-8b57c0473056`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:23:49,112::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:49,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c00c5e2-e5de-4a67-8dfd-8b57c0473056`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:49,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c00c5e2-e5de-4a67-8dfd-8b57c0473056`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:23:49,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:23:49,123::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16::DEBUG::2014-08-12 15:23:49,125::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-32::DEBUG::2014-08-12 15:23:49,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:23:49,139::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:23:49,140::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-16::DEBUG::2014-08-12 15:23:49,140::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058403 s, 7.0 MB/s\n'; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:23:49,141::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:23:49,152::task::993::Storage.TaskManager.Task::(_decref) Task=`0c00c5e2-e5de-4a67-8dfd-8b57c0473056`::ref 0 aborting False >Thread-25::DEBUG::2014-08-12 15:23:49,162::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:49,162::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:23:49,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:49,163::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:49,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:49,163::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:49,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:49,163::__init__::225::IOProcess::(_processLogs) (14532) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:49,164::__init__::225::IOProcess::(_processLogs) (14532) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:49,164::__init__::225::IOProcess::(_processLogs) (14532) Building response >Thread-25::DEBUG::2014-08-12 15:23:49,164::__init__::225::IOProcess::(_processLogs) (14532) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:49,164::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:49,164::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:23:49,165::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:49,165::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:23:49,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:49,166::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:49,166::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:49,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:49,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:49,166::__init__::225::IOProcess::(_processLogs) (14533) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:49,166::__init__::225::IOProcess::(_processLogs) (14533) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:49,167::__init__::225::IOProcess::(_processLogs) (14533) Building response >Thread-25::DEBUG::2014-08-12 15:23:49,167::__init__::225::IOProcess::(_processLogs) (14533) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:49,167::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:49,167::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:23:49,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:49,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120735 s, 84.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:50,034::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:50,035::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:50,045::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:23:51,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:52,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124156 s, 82.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:52,371::BindingXMLRPC::1127::vds::(wrapper) client [10.35.161.45]::call vmHotunplugDisk with ({'vmId': '934767dd-bbad-4f2e-a372-28aef807713a', 'drive': {'iface': 'virtio', 'format': 'cow', 'optional': 'false', 'poolID': 'fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'volumeID': '8ca0be31-0682-4366-87a3-fd676a23aa0d', 'imageID': '8b326e85-a567-45a3-801f-92819e343637', 'readonly': 'false', 'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'deviceId': '8b326e85-a567-45a3-801f-92819e343637', 'address': {'slot': '0x0a', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}},) {} flowID [579c5f8] >Thread-14::DEBUG::2014-08-12 15:23:52,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e60af06-60e9-48fa-adbc-a6e7fbda0758`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:52,372::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', leafUUID='8ca0be31-0682-4366-87a3-fd676a23aa0d') >Thread-14::DEBUG::2014-08-12 15:23:52,373::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`250f4dbe-7429-44fb-a1de-290810ce843e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >Thread-14::DEBUG::2014-08-12 15:23:52,373::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'shared' >Thread-14::DEBUG::2014-08-12 15:23:52,373::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-08-12 15:23:52,373::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`250f4dbe-7429-44fb-a1de-290810ce843e`::Granted request >Thread-14::DEBUG::2014-08-12 15:23:52,374::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0e60af06-60e9-48fa-adbc-a6e7fbda0758`::_resourcesAcquired: Storage.180aea8f-26ba-4e87-8a94-37d5469519bf (shared) >Thread-14::DEBUG::2014-08-12 15:23:52,374::task::993::Storage.TaskManager.Task::(_decref) Task=`0e60af06-60e9-48fa-adbc-a6e7fbda0758`::ref 1 aborting False >Thread-14::DEBUG::2014-08-12 15:23:52,374::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:52,374::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-14::DEBUG::2014-08-12 15:23:52,599::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:52,601::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-14::DEBUG::2014-08-12 15:23:52,601::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:52,602::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637 >Thread-14::WARNING::2014-08-12 15:23:52,602::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637 already exists >Thread-14::DEBUG::2014-08-12 15:23:52,603::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/b738f279-1cff-47fb-bca0-2d22c17f3694 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637/b738f279-1cff-47fb-bca0-2d22c17f3694 >Thread-14::DEBUG::2014-08-12 15:23:52,603::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637/b738f279-1cff-47fb-bca0-2d22c17f3694 >Thread-14::DEBUG::2014-08-12 15:23:52,603::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/8ca0be31-0682-4366-87a3-fd676a23aa0d to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d >Thread-14::DEBUG::2014-08-12 15:23:52,603::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d >Thread-14::DEBUG::2014-08-12 15:23:52,603::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/124cfa4e-73c5-4c56-8bb0-b67668d08353 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637/124cfa4e-73c5-4c56-8bb0-b67668d08353 >Thread-14::DEBUG::2014-08-12 15:23:52,603::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637/124cfa4e-73c5-4c56-8bb0-b67668d08353 >Thread-14::DEBUG::2014-08-12 15:23:52,603::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/dc602b35-56ee-4b4f-bda7-e7813bf53b94 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637/dc602b35-56ee-4b4f-bda7-e7813bf53b94 >Thread-14::DEBUG::2014-08-12 15:23:52,604::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637/dc602b35-56ee-4b4f-bda7-e7813bf53b94 >Thread-14::DEBUG::2014-08-12 15:23:52,604::blockSD::1045::Storage.StorageDomain::(linkBCImage) Creating symlink from /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/8b326e85-a567-45a3-801f-92819e343637 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637 >Thread-14::DEBUG::2014-08-12 15:23:52,604::blockSD::1051::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637 >Thread-14::INFO::2014-08-12 15:23:52,605::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 122683392, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d', 'volumeID': '8ca0be31-0682-4366-87a3-fd676a23aa0d', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}, 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d', 'imgVolumesInfo': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 119537664, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/b738f279-1cff-47fb-bca0-2d22c17f3694', 'volumeID': 'b738f279-1cff-47fb-bca0-2d22c17f3694', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 122683392, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d', 'volumeID': '8ca0be31-0682-4366-87a3-fd676a23aa0d', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 112197632, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/124cfa4e-73c5-4c56-8bb0-b67668d08353', 'volumeID': '124cfa4e-73c5-4c56-8bb0-b67668d08353', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 115343360, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/dc602b35-56ee-4b4f-bda7-e7813bf53b94', 'volumeID': 'dc602b35-56ee-4b4f-bda7-e7813bf53b94', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}]} >Thread-14::DEBUG::2014-08-12 15:23:52,605::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e60af06-60e9-48fa-adbc-a6e7fbda0758`::finished: {'info': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 122683392, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d', 'volumeID': '8ca0be31-0682-4366-87a3-fd676a23aa0d', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}, 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d', 'imgVolumesInfo': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 119537664, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/b738f279-1cff-47fb-bca0-2d22c17f3694', 'volumeID': 'b738f279-1cff-47fb-bca0-2d22c17f3694', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 122683392, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d', 'volumeID': '8ca0be31-0682-4366-87a3-fd676a23aa0d', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 112197632, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/124cfa4e-73c5-4c56-8bb0-b67668d08353', 'volumeID': '124cfa4e-73c5-4c56-8bb0-b67668d08353', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 115343360, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/dc602b35-56ee-4b4f-bda7-e7813bf53b94', 'volumeID': 'dc602b35-56ee-4b4f-bda7-e7813bf53b94', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '8b326e85-a567-45a3-801f-92819e343637'}]} >Thread-14::DEBUG::2014-08-12 15:23:52,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e60af06-60e9-48fa-adbc-a6e7fbda0758`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:52,606::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-08-12 15:23:52,606::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:52,606::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' >Thread-14::DEBUG::2014-08-12 15:23:52,606::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >Thread-14::DEBUG::2014-08-12 15:23:52,606::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-08-12 15:23:52,607::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >Thread-14::DEBUG::2014-08-12 15:23:52,607::task::993::Storage.TaskManager.Task::(_decref) Task=`0e60af06-60e9-48fa-adbc-a6e7fbda0758`::ref 0 aborting False >Thread-14::INFO::2014-08-12 15:23:52,607::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d >Thread-14::DEBUG::2014-08-12 15:23:52,609::vm::3841::vm.Vm::(hotunplugDisk) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Hotunplug disk xml: <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x0a" type="pci"/> > <source dev="/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/8ca0be31-0682-4366-87a3-fd676a23aa0d"/> > <target bus="virtio" dev="vdd"/> > <serial>8b326e85-a567-45a3-801f-92819e343637</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> ></disk> > >Thread-14::DEBUG::2014-08-12 15:23:52,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce4deb88-e53f-4c2c-8dda-b9e19165361e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:52,770::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', volUUID=None) >Thread-14::DEBUG::2014-08-12 15:23:52,771::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`38437a98-4320-4bbb-aa9b-b6a3fa670a19`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3252' at 'teardownImage' >Thread-14::DEBUG::2014-08-12 15:23:52,771::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'shared' >Thread-14::DEBUG::2014-08-12 15:23:52,771::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-08-12 15:23:52,771::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`38437a98-4320-4bbb-aa9b-b6a3fa670a19`::Granted request >Thread-14::DEBUG::2014-08-12 15:23:52,772::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce4deb88-e53f-4c2c-8dda-b9e19165361e`::_resourcesAcquired: Storage.180aea8f-26ba-4e87-8a94-37d5469519bf (shared) >Thread-14::DEBUG::2014-08-12 15:23:52,772::task::993::Storage.TaskManager.Task::(_decref) Task=`ce4deb88-e53f-4c2c-8dda-b9e19165361e`::ref 1 aborting False >Thread-14::DEBUG::2014-08-12 15:23:52,772::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:52,772::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-14::DEBUG::2014-08-12 15:23:52,947::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:52,949::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-14::DEBUG::2014-08-12 15:23:52,949::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:52,950::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --autobackup n --available n 180aea8f-26ba-4e87-8a94-37d5469519bf/b738f279-1cff-47fb-bca0-2d22c17f3694 180aea8f-26ba-4e87-8a94-37d5469519bf/8ca0be31-0682-4366-87a3-fd676a23aa0d 180aea8f-26ba-4e87-8a94-37d5469519bf/124cfa4e-73c5-4c56-8bb0-b67668d08353 180aea8f-26ba-4e87-8a94-37d5469519bf/dc602b35-56ee-4b4f-bda7-e7813bf53b94 (cwd None) >Thread-14::DEBUG::2014-08-12 15:23:53,155::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:53,155::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:53,155::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::INFO::2014-08-12 15:23:53,156::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-14::DEBUG::2014-08-12 15:23:53,156::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce4deb88-e53f-4c2c-8dda-b9e19165361e`::finished: None >Thread-14::DEBUG::2014-08-12 15:23:53,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce4deb88-e53f-4c2c-8dda-b9e19165361e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:53,156::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-08-12 15:23:53,156::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:53,157::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' >Thread-14::DEBUG::2014-08-12 15:23:53,157::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >Thread-14::DEBUG::2014-08-12 15:23:53,157::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-08-12 15:23:53,157::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >Thread-14::DEBUG::2014-08-12 15:23:53,158::task::993::Storage.TaskManager.Task::(_decref) Task=`ce4deb88-e53f-4c2c-8dda-b9e19165361e`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:23:53,158::BindingXMLRPC::1134::vds::(wrapper) return vmHotunplugDisk with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'pid': '28742', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Westmere', 'smp': '4', 'numaTune': {'mode': 'preferred'}, 'custom': {}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'vm_398664', 'nice': '0', 'status': 'Up', 'bootMenuEnable': 'false', 'vmId': '934767dd-bbad-4f2e-a372-28aef807713a', 'copyPasteEnable': 'true', 'displayIp': '10.35.64.87', 'displayPort': u'5900', 'smartcardEnable': 'false', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'fileTransferEnable': 'true', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'devices': [{'alias': u'sound0', 'specParams': {}, 'deviceId': '8e6b15ee-5b65-4919-97b8-a5313197a105', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'ich6', 'type': 'sound'}, {'target': 1048576, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': 'df4c3c7d-66a2-4cbf-8f96-cb5732317965', 'address': {u'slot': u'0x08', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'index': '0', 'alias': u'scsi0', 'specParams': {}, 'deviceId': 'f2f2cd32-6bfd-4872-92a5-87810e917978', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': 'ec65cf24-87f0-4049-9e03-8504007a1bdb', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'device': 'spice', 'specParams': {'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'copyPasteEnable': 'true', 'keyMap': 'en-us', 'displayIp': '10.35.64.87', 'displayNetwork': 'ovirtmgmt'}, 'type': 'graphics', 'port': u'5900', 'tlsPort': u'5901'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:e2:c9:00', 'linkActive': True, 'network': 'ovirtmgmt', 'alias': u'net0', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1fda0e2f-7f41-4119-abe1-1d0bbf4c4c0b', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '1251f1e4-8195-4ec5-a178-a0e1d2170da1', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'reqsize': '0', 'format': 'cow', 'deviceId': 'b790c316-c040-4ed2-89d9-ace073387615', 'poolID': 'fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'device': 'disk', 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'specParams': {}, 'volumeChain': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/7169f8be-d731-430e-b21e-adaf5afae8bb', 'volumeID': '7169f8be-d731-430e-b21e-adaf5afae8bb', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/9a5096b4-65cc-465b-9e86-54aaf67073a7', 'volumeID': '9a5096b4-65cc-465b-9e86-54aaf67073a7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}]}, {'address': {u'slot': u'0x0b', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 121634816, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, 'index': '1', 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk1', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'reqsize': '0', 'format': 'cow', 'deviceId': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', 'poolID': 'fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'device': 'disk', 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vdb', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'specParams': {}, 'volumeChain': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 121634816, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 110100480, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/7fa014f5-6f3d-4254-a67a-3f09d1689e44', 'volumeID': '7fa014f5-6f3d-4254-a67a-3f09d1689e44', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 114294784, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/003139aa-00e5-460f-8895-a675bb051afa', 'volumeID': '003139aa-00e5-460f-8895-a675bb051afa', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 118489088, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/354f2204-1187-4dcc-be3c-93cc95d28ee8', 'volumeID': '354f2204-1187-4dcc-be3c-93cc95d28ee8', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}]}, {'address': {u'slot': u'0x09', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 123731968, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'volumeID': '7bc4d940-6844-4473-aded-d04d3afc89f7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, 'index': '2', 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk2', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'reqsize': '0', 'format': 'cow', 'deviceId': '9c06af0f-2451-41f1-a031-d08c4950266d', 'poolID': 'fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'device': 'disk', 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vdc', 'volumeID': '7bc4d940-6844-4473-aded-d04d3afc89f7', 'specParams': {}, 'volumeChain': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/4f65bc56-87ae-4b08-aa65-75103525d7ef', 'volumeID': '4f65bc56-87ae-4b08-aa65-75103525d7ef', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/1d7d814c-7bad-4412-8e95-d178dd18f223', 'volumeID': '1d7d814c-7bad-4412-8e95-d178dd18f223', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 116391936, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/eaf69f9d-59f2-4c3f-9795-cf3a71045db6', 'volumeID': 'eaf69f9d-59f2-4c3f-9795-cf3a71045db6', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 123731968, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'volumeID': '7bc4d940-6844-4473-aded-d04d3afc89f7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}]}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'timeOffset': '0', 'maxVCpus': '160', 'clientIp': '', 'display': 'qxl'}} >Thread-14::DEBUG::2014-08-12 15:23:53,222::BindingXMLRPC::1127::vds::(wrapper) client [10.35.161.45]::call vmHotunplugDisk with ({'vmId': '934767dd-bbad-4f2e-a372-28aef807713a', 'drive': {'iface': 'virtio', 'format': 'cow', 'optional': 'false', 'poolID': 'fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'volumeID': '7bc4d940-6844-4473-aded-d04d3afc89f7', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d', 'readonly': 'false', 'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'deviceId': '9c06af0f-2451-41f1-a031-d08c4950266d', 'address': {'slot': '0x09', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}},) {} flowID [7db41f96] >Thread-14::DEBUG::2014-08-12 15:23:53,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`679fac8d-a594-46b9-9fcb-51ebbf5cbd89`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:53,223::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', leafUUID='7bc4d940-6844-4473-aded-d04d3afc89f7') >Thread-14::DEBUG::2014-08-12 15:23:53,224::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`0d4c3b75-934c-45d2-b3b2-2bfe652e024c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >Thread-14::DEBUG::2014-08-12 15:23:53,224::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'shared' >Thread-14::DEBUG::2014-08-12 15:23:53,224::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-08-12 15:23:53,224::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`0d4c3b75-934c-45d2-b3b2-2bfe652e024c`::Granted request >Thread-14::DEBUG::2014-08-12 15:23:53,225::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`679fac8d-a594-46b9-9fcb-51ebbf5cbd89`::_resourcesAcquired: Storage.180aea8f-26ba-4e87-8a94-37d5469519bf (shared) >Thread-14::DEBUG::2014-08-12 15:23:53,225::task::993::Storage.TaskManager.Task::(_decref) Task=`679fac8d-a594-46b9-9fcb-51ebbf5cbd89`::ref 1 aborting False >Thread-14::DEBUG::2014-08-12 15:23:53,225::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:53,225::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-14::DEBUG::2014-08-12 15:23:53,398::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:53,400::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-14::DEBUG::2014-08-12 15:23:53,400::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:53,401::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d >Thread-14::WARNING::2014-08-12 15:23:53,401::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d already exists >Thread-14::DEBUG::2014-08-12 15:23:53,401::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/4f65bc56-87ae-4b08-aa65-75103525d7ef to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d/4f65bc56-87ae-4b08-aa65-75103525d7ef >Thread-14::DEBUG::2014-08-12 15:23:53,401::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d/4f65bc56-87ae-4b08-aa65-75103525d7ef >Thread-14::DEBUG::2014-08-12 15:23:53,401::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/1d7d814c-7bad-4412-8e95-d178dd18f223 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d/1d7d814c-7bad-4412-8e95-d178dd18f223 >Thread-14::DEBUG::2014-08-12 15:23:53,402::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d/1d7d814c-7bad-4412-8e95-d178dd18f223 >Thread-14::DEBUG::2014-08-12 15:23:53,402::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/eaf69f9d-59f2-4c3f-9795-cf3a71045db6 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d/eaf69f9d-59f2-4c3f-9795-cf3a71045db6 >Thread-14::DEBUG::2014-08-12 15:23:53,402::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d/eaf69f9d-59f2-4c3f-9795-cf3a71045db6 >Thread-14::DEBUG::2014-08-12 15:23:53,402::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/7bc4d940-6844-4473-aded-d04d3afc89f7 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7 >Thread-14::DEBUG::2014-08-12 15:23:53,402::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7 >Thread-14::DEBUG::2014-08-12 15:23:53,402::blockSD::1045::Storage.StorageDomain::(linkBCImage) Creating symlink from /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/9c06af0f-2451-41f1-a031-d08c4950266d to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d >Thread-14::DEBUG::2014-08-12 15:23:53,404::blockSD::1051::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d >Thread-14::INFO::2014-08-12 15:23:53,404::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 123731968, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'volumeID': '7bc4d940-6844-4473-aded-d04d3afc89f7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'imgVolumesInfo': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/4f65bc56-87ae-4b08-aa65-75103525d7ef', 'volumeID': '4f65bc56-87ae-4b08-aa65-75103525d7ef', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/1d7d814c-7bad-4412-8e95-d178dd18f223', 'volumeID': '1d7d814c-7bad-4412-8e95-d178dd18f223', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 116391936, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/eaf69f9d-59f2-4c3f-9795-cf3a71045db6', 'volumeID': 'eaf69f9d-59f2-4c3f-9795-cf3a71045db6', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 123731968, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'volumeID': '7bc4d940-6844-4473-aded-d04d3afc89f7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}]} >Thread-14::DEBUG::2014-08-12 15:23:53,405::task::1191::Storage.TaskManager.Task::(prepare) Task=`679fac8d-a594-46b9-9fcb-51ebbf5cbd89`::finished: {'info': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 123731968, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'volumeID': '7bc4d940-6844-4473-aded-d04d3afc89f7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'imgVolumesInfo': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/4f65bc56-87ae-4b08-aa65-75103525d7ef', 'volumeID': '4f65bc56-87ae-4b08-aa65-75103525d7ef', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 120586240, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/1d7d814c-7bad-4412-8e95-d178dd18f223', 'volumeID': '1d7d814c-7bad-4412-8e95-d178dd18f223', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 116391936, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/eaf69f9d-59f2-4c3f-9795-cf3a71045db6', 'volumeID': 'eaf69f9d-59f2-4c3f-9795-cf3a71045db6', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 123731968, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7', 'volumeID': '7bc4d940-6844-4473-aded-d04d3afc89f7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': '9c06af0f-2451-41f1-a031-d08c4950266d'}]} >Thread-14::DEBUG::2014-08-12 15:23:53,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`679fac8d-a594-46b9-9fcb-51ebbf5cbd89`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:53,405::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-08-12 15:23:53,405::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:53,406::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' >Thread-14::DEBUG::2014-08-12 15:23:53,406::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >Thread-14::DEBUG::2014-08-12 15:23:53,406::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-08-12 15:23:53,406::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >Thread-14::DEBUG::2014-08-12 15:23:53,406::task::993::Storage.TaskManager.Task::(_decref) Task=`679fac8d-a594-46b9-9fcb-51ebbf5cbd89`::ref 0 aborting False >Thread-14::INFO::2014-08-12 15:23:53,407::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7 >Thread-14::DEBUG::2014-08-12 15:23:53,408::vm::3841::vm.Vm::(hotunplugDisk) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Hotunplug disk xml: <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x09" type="pci"/> > <source dev="/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7"/> > <target bus="virtio" dev="vdc"/> > <serial>9c06af0f-2451-41f1-a031-d08c4950266d</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> ></disk> > >Thread-14::DEBUG::2014-08-12 15:23:53,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfe90586-f64d-4bf2-8d95-78b23fb0fafd`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:53,585::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', volUUID=None) >Thread-14::DEBUG::2014-08-12 15:23:53,586::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`625cf90d-58c9-4681-a667-67e790ef36a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3252' at 'teardownImage' >Thread-14::DEBUG::2014-08-12 15:23:53,586::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'shared' >Thread-14::DEBUG::2014-08-12 15:23:53,586::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-08-12 15:23:53,586::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`625cf90d-58c9-4681-a667-67e790ef36a1`::Granted request >Thread-14::DEBUG::2014-08-12 15:23:53,586::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bfe90586-f64d-4bf2-8d95-78b23fb0fafd`::_resourcesAcquired: Storage.180aea8f-26ba-4e87-8a94-37d5469519bf (shared) >Thread-14::DEBUG::2014-08-12 15:23:53,587::task::993::Storage.TaskManager.Task::(_decref) Task=`bfe90586-f64d-4bf2-8d95-78b23fb0fafd`::ref 1 aborting False >Thread-14::DEBUG::2014-08-12 15:23:53,587::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:53,587::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-14::DEBUG::2014-08-12 15:23:53,760::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:53,762::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-14::DEBUG::2014-08-12 15:23:53,762::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:53,763::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --autobackup n --available n 180aea8f-26ba-4e87-8a94-37d5469519bf/4f65bc56-87ae-4b08-aa65-75103525d7ef 180aea8f-26ba-4e87-8a94-37d5469519bf/1d7d814c-7bad-4412-8e95-d178dd18f223 180aea8f-26ba-4e87-8a94-37d5469519bf/eaf69f9d-59f2-4c3f-9795-cf3a71045db6 180aea8f-26ba-4e87-8a94-37d5469519bf/7bc4d940-6844-4473-aded-d04d3afc89f7 (cwd None) >Thread-14::DEBUG::2014-08-12 15:23:53,953::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:53,953::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-08-12 15:23:53,953::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::INFO::2014-08-12 15:23:53,954::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-14::DEBUG::2014-08-12 15:23:53,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`bfe90586-f64d-4bf2-8d95-78b23fb0fafd`::finished: None >Thread-14::DEBUG::2014-08-12 15:23:53,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfe90586-f64d-4bf2-8d95-78b23fb0fafd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:53,954::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-08-12 15:23:53,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:53,955::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' >Thread-14::DEBUG::2014-08-12 15:23:53,955::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >Thread-14::DEBUG::2014-08-12 15:23:53,955::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-08-12 15:23:53,955::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >Thread-14::DEBUG::2014-08-12 15:23:53,956::task::993::Storage.TaskManager.Task::(_decref) Task=`bfe90586-f64d-4bf2-8d95-78b23fb0fafd`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:23:53,956::BindingXMLRPC::1134::vds::(wrapper) return vmHotunplugDisk with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'pid': '28742', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Westmere', 'smp': '4', 'numaTune': {'mode': 'preferred'}, 'custom': {}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '2', 'vmName': 'vm_398664', 'nice': '0', 'status': 'Up', 'bootMenuEnable': 'false', 'vmId': '934767dd-bbad-4f2e-a372-28aef807713a', 'copyPasteEnable': 'true', 'displayIp': '10.35.64.87', 'displayPort': u'5900', 'smartcardEnable': 'false', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'fileTransferEnable': 'true', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt', 'devices': [{'alias': u'sound0', 'specParams': {}, 'deviceId': '8e6b15ee-5b65-4919-97b8-a5313197a105', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'ich6', 'type': 'sound'}, {'target': 1048576, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': 'df4c3c7d-66a2-4cbf-8f96-cb5732317965', 'address': {u'slot': u'0x08', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'index': '0', 'alias': u'scsi0', 'specParams': {}, 'deviceId': 'f2f2cd32-6bfd-4872-92a5-87810e917978', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': 'ec65cf24-87f0-4049-9e03-8504007a1bdb', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'device': 'spice', 'specParams': {'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'copyPasteEnable': 'true', 'keyMap': 'en-us', 'displayIp': '10.35.64.87', 'displayNetwork': 'ovirtmgmt'}, 'type': 'graphics', 'port': u'5900', 'tlsPort': u'5901'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:e2:c9:00', 'linkActive': True, 'network': 'ovirtmgmt', 'alias': u'net0', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1fda0e2f-7f41-4119-abe1-1d0bbf4c4c0b', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '1251f1e4-8195-4ec5-a178-a0e1d2170da1', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk0', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'reqsize': '0', 'format': 'cow', 'deviceId': 'b790c316-c040-4ed2-89d9-ace073387615', 'poolID': 'fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'device': 'disk', 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'specParams': {}, 'volumeChain': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/7169f8be-d731-430e-b21e-adaf5afae8bb', 'volumeID': '7169f8be-d731-430e-b21e-adaf5afae8bb', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/9a5096b4-65cc-465b-9e86-54aaf67073a7', 'volumeID': '9a5096b4-65cc-465b-9e86-54aaf67073a7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}]}, {'address': {u'slot': u'0x0b', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 121634816, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, 'index': '1', 'iface': 'virtio', 'apparentsize': '1073741824', 'alias': u'virtio-disk1', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', 'readonly': 'False', 'shared': 'false', 'truesize': '1073741824', 'type': 'disk', 'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'reqsize': '0', 'format': 'cow', 'deviceId': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', 'poolID': 'fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'device': 'disk', 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vdb', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'specParams': {}, 'volumeChain': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 121634816, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 110100480, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/7fa014f5-6f3d-4254-a67a-3f09d1689e44', 'volumeID': '7fa014f5-6f3d-4254-a67a-3f09d1689e44', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 114294784, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/003139aa-00e5-460f-8895-a675bb051afa', 'volumeID': '003139aa-00e5-460f-8895-a675bb051afa', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 118489088, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/354f2204-1187-4dcc-be3c-93cc95d28ee8', 'volumeID': '354f2204-1187-4dcc-be3c-93cc95d28ee8', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}]}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'timeOffset': '0', 'maxVCpus': '160', 'clientIp': '', 'display': 'qxl'}} >Dummy-31::DEBUG::2014-08-12 15:23:54,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:54,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122604 s, 83.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:55,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:55,053::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:23:55,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:23:55,224::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:23:56,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:56,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124686 s, 82.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:23:58,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:23:58,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01212 s, 84.5 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:23:58,514::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:23:58,525::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685205 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:23:59,169::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:23:59,181::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609302 s, 6.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:23:59,181::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [7eef42eb] >Thread-14::DEBUG::2014-08-12 15:23:59,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c8dee02-b974-4ef1-8204-af35c904afd1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:23:59,185::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-25::DEBUG::2014-08-12 15:23:59,188::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:59,188::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:23:59,189::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:59,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:59,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:59,189::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:59,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:59,190::__init__::225::IOProcess::(_processLogs) (14534) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:59,190::__init__::225::IOProcess::(_processLogs) (14534) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:59,190::__init__::225::IOProcess::(_processLogs) (14534) Building response >Thread-25::DEBUG::2014-08-12 15:23:59,190::__init__::225::IOProcess::(_processLogs) (14534) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:59,190::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:59,190::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:23:59,191::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:23:59,191::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:23:59,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:23:59,192::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:23:59,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:23:59,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:23:59,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:23:59,192::__init__::225::IOProcess::(_processLogs) (14535) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:23:59,192::__init__::225::IOProcess::(_processLogs) (14535) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:23:59,193::__init__::225::IOProcess::(_processLogs) (14535) Building response >Thread-25::DEBUG::2014-08-12 15:23:59,193::__init__::225::IOProcess::(_processLogs) (14535) Queuing response >Thread-25::DEBUG::2014-08-12 15:23:59,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:23:59,193::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::INFO::2014-08-12 15:23:59,216::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:59,217::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c8dee02-b974-4ef1-8204-af35c904afd1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:23:59,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c8dee02-b974-4ef1-8204-af35c904afd1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:23:59,217::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:23:59,217::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:23:59,217::task::993::Storage.TaskManager.Task::(_decref) Task=`6c8dee02-b974-4ef1-8204-af35c904afd1`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:23:59,228::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [7eef42eb] >Thread-32::DEBUG::2014-08-12 15:23:59,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`766b90d5-2b24-4017-8dbd-ddc77dd1deb4`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:23:59,229::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:23:59,229::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`74de7753-4390-45d7-aad0-91f949e7b32f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:23:59,229::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:23:59,229::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:23:59,230::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`74de7753-4390-45d7-aad0-91f949e7b32f`::Granted request >Thread-32::DEBUG::2014-08-12 15:23:59,230::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`766b90d5-2b24-4017-8dbd-ddc77dd1deb4`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:23:59,230::task::993::Storage.TaskManager.Task::(_decref) Task=`766b90d5-2b24-4017-8dbd-ddc77dd1deb4`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:23:59,243::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:59,243::task::1191::Storage.TaskManager.Task::(prepare) Task=`766b90d5-2b24-4017-8dbd-ddc77dd1deb4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '1879048192', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:23:59,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`766b90d5-2b24-4017-8dbd-ddc77dd1deb4`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:23:59,243::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:23:59,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:23:59,244::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:23:59,244::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:23:59,244::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:23:59,244::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:23:59,244::task::993::Storage.TaskManager.Task::(_decref) Task=`766b90d5-2b24-4017-8dbd-ddc77dd1deb4`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:00,060::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:00,061::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:00,062::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:00,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:00,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122279 s, 83.7 MB/s\n'; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:24:01,048::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [3b39f86c] >Thread-32::DEBUG::2014-08-12 15:24:01,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:24:01,048::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='8b326e85-a567-45a3-801f-92819e343637', postZero='false', force='false') >Thread-32::DEBUG::2014-08-12 15:24:01,049::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`917e0e14-7f07-46df-ac51-56e9fb9cc6e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1497' at 'deleteImage' >Thread-32::DEBUG::2014-08-12 15:24:01,049::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'exclusive' >Thread-32::DEBUG::2014-08-12 15:24:01,049::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'exclusive' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:01,050::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`917e0e14-7f07-46df-ac51-56e9fb9cc6e8`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:01,050::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::_resourcesAcquired: Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf (exclusive) >Thread-32::DEBUG::2014-08-12 15:24:01,050::task::993::Storage.TaskManager.Task::(_decref) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::ref 1 aborting False >Thread-32::DEBUG::2014-08-12 15:24:01,051::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`f788dab9-8284-4496-9759-da4ec83e30e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1498' at 'deleteImage' >Thread-32::DEBUG::2014-08-12 15:24:01,051::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:24:01,051::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:01,051::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`f788dab9-8284-4496-9759-da4ec83e30e1`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:01,051::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::_resourcesAcquired: Storage.180aea8f-26ba-4e87-8a94-37d5469519bf (shared) >Thread-32::DEBUG::2014-08-12 15:24:01,052::task::993::Storage.TaskManager.Task::(_decref) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::ref 1 aborting False >Thread-32::DEBUG::2014-08-12 15:24:01,052::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,052::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-32::DEBUG::2014-08-12 15:24:01,230::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:24:01,231::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-32::DEBUG::2014-08-12 15:24:01,231::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,232::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --autobackup n -a y --deltag IU_8b326e85-a567-45a3-801f-92819e343637 --addtag IU__remove_me_8b326e85-a567-45a3-801f-92819e343637 180aea8f-26ba-4e87-8a94-37d5469519bf/b738f279-1cff-47fb-bca0-2d22c17f3694 180aea8f-26ba-4e87-8a94-37d5469519bf/8ca0be31-0682-4366-87a3-fd676a23aa0d 180aea8f-26ba-4e87-8a94-37d5469519bf/124cfa4e-73c5-4c56-8bb0-b67668d08353 180aea8f-26ba-4e87-8a94-37d5469519bf/dc602b35-56ee-4b4f-bda7-e7813bf53b94 (cwd None) >Thread-32::DEBUG::2014-08-12 15:24:01,686::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:24:01,686::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,687::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::WARNING::2014-08-12 15:24:01,687::lvm::1087::Storage.LVM::(removeLVs) Removing active volume 180aea8f-26ba-4e87-8a94-37d5469519bf/b738f279-1cff-47fb-bca0-2d22c17f3694 >Thread-32::WARNING::2014-08-12 15:24:01,687::lvm::1087::Storage.LVM::(removeLVs) Removing active volume 180aea8f-26ba-4e87-8a94-37d5469519bf/8ca0be31-0682-4366-87a3-fd676a23aa0d >Thread-32::WARNING::2014-08-12 15:24:01,687::lvm::1087::Storage.LVM::(removeLVs) Removing active volume 180aea8f-26ba-4e87-8a94-37d5469519bf/124cfa4e-73c5-4c56-8bb0-b67668d08353 >Thread-32::WARNING::2014-08-12 15:24:01,687::lvm::1087::Storage.LVM::(removeLVs) Removing active volume 180aea8f-26ba-4e87-8a94-37d5469519bf/dc602b35-56ee-4b4f-bda7-e7813bf53b94 >Thread-32::DEBUG::2014-08-12 15:24:01,688::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvremove --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' -f --autobackup n 180aea8f-26ba-4e87-8a94-37d5469519bf/b738f279-1cff-47fb-bca0-2d22c17f3694 180aea8f-26ba-4e87-8a94-37d5469519bf/8ca0be31-0682-4366-87a3-fd676a23aa0d 180aea8f-26ba-4e87-8a94-37d5469519bf/124cfa4e-73c5-4c56-8bb0-b67668d08353 180aea8f-26ba-4e87-8a94-37d5469519bf/dc602b35-56ee-4b4f-bda7-e7813bf53b94 (cwd None) >Thread-32::DEBUG::2014-08-12 15:24:01,970::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:24:01,970::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,971::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,971::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,971::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,971::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,972::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,972::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,972::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:01,972::blockSD::946::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637/dc602b35-56ee-4b4f-bda7-e7813bf53b94'] >Thread-32::DEBUG::2014-08-12 15:24:01,980::blockSD::957::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/8b326e85-a567-45a3-801f-92819e343637 >Thread-25::DEBUG::2014-08-12 15:24:01,984::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:01,985::__init__::225::IOProcess::(_processLogs) Message size is 72 >Thread-25::DEBUG::2014-08-12 15:24:01,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:01,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:01,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:01,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:01,991::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:01,992::__init__::225::IOProcess::(_processLogs) (14536) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:01,993::__init__::225::IOProcess::(_processLogs) (14536) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:01,993::__init__::225::IOProcess::(_processLogs) (14536) Building response >Thread-25::DEBUG::2014-08-12 15:24:01,994::__init__::225::IOProcess::(_processLogs) (14536) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:01,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:01,996::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:02,000::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,001::__init__::225::IOProcess::(_processLogs) Message size is 76 >Thread-25::DEBUG::2014-08-12 15:24:02,002::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,005::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,006::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,007::__init__::225::IOProcess::(_processLogs) (14537) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,007::__init__::225::IOProcess::(_processLogs) (14537) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,008::__init__::225::IOProcess::(_processLogs) (14537) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,009::__init__::225::IOProcess::(_processLogs) (14537) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,010::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,011::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:02,014::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,015::__init__::225::IOProcess::(_processLogs) Message size is 88 >Thread-25::DEBUG::2014-08-12 15:24:02,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,019::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,021::__init__::225::IOProcess::(_processLogs) (14538) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,022::__init__::225::IOProcess::(_processLogs) (14538) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,022::__init__::225::IOProcess::(_processLogs) (14538) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,023::__init__::225::IOProcess::(_processLogs) (14538) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,025::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:02,028::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,029::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-25::DEBUG::2014-08-12 15:24:02,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,031::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,033::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,035::__init__::225::IOProcess::(_processLogs) (14539) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,036::__init__::225::IOProcess::(_processLogs) (14539) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,037::__init__::225::IOProcess::(_processLogs) (14539) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,037::__init__::225::IOProcess::(_processLogs) (14539) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,038::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,039::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:02,043::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,043::__init__::225::IOProcess::(_processLogs) Message size is 134 >Thread-25::DEBUG::2014-08-12 15:24:02,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,047::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,049::__init__::225::IOProcess::(_processLogs) (14540) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,050::__init__::225::IOProcess::(_processLogs) (14540) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,051::__init__::225::IOProcess::(_processLogs) (14540) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,052::__init__::225::IOProcess::(_processLogs) (14540) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,053::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,053::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:02,057::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,058::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-25::DEBUG::2014-08-12 15:24:02,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,060::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,060::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,062::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,064::__init__::225::IOProcess::(_processLogs) (14541) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,064::__init__::225::IOProcess::(_processLogs) (14541) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,065::__init__::225::IOProcess::(_processLogs) (14541) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,066::__init__::225::IOProcess::(_processLogs) (14541) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,068::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:02,071::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,072::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:24:02,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,074::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,076::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,076::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,077::__init__::225::IOProcess::(_processLogs) (14542) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,078::__init__::225::IOProcess::(_processLogs) (14542) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,079::__init__::225::IOProcess::(_processLogs) (14542) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,080::__init__::225::IOProcess::(_processLogs) (14542) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,081::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,082::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:02,085::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,086::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-25::DEBUG::2014-08-12 15:24:02,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,089::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,091::__init__::225::IOProcess::(_processLogs) (14543) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,092::__init__::225::IOProcess::(_processLogs) (14543) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,093::__init__::225::IOProcess::(_processLogs) (14543) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,094::__init__::225::IOProcess::(_processLogs) (14543) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,096::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,099::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,100::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:02,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,104::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,106::__init__::225::IOProcess::(_processLogs) (14544) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,107::__init__::225::IOProcess::(_processLogs) (14544) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,107::__init__::225::IOProcess::(_processLogs) (14544) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,108::__init__::225::IOProcess::(_processLogs) (14544) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,109::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,110::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:02,113::task::752::Storage.TaskManager.Task::(_save) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d.temp >Thread-25::DEBUG::2014-08-12 15:24:02,115::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,115::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,117::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,119::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,121::__init__::225::IOProcess::(_processLogs) (14545) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,122::__init__::225::IOProcess::(_processLogs) (14545) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,124::__init__::225::IOProcess::(_processLogs) (14545) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,125::__init__::225::IOProcess::(_processLogs) (14545) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,127::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,130::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,131::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,133::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,136::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,138::__init__::225::IOProcess::(_processLogs) (14546) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,139::__init__::225::IOProcess::(_processLogs) (14546) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,140::__init__::225::IOProcess::(_processLogs) (14546) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,141::__init__::225::IOProcess::(_processLogs) (14546) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,143::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,147::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,148::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:02,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,150::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,153::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,155::__init__::225::IOProcess::(_processLogs) (14547) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,156::__init__::225::IOProcess::(_processLogs) (14547) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,157::__init__::225::IOProcess::(_processLogs) (14547) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,158::__init__::225::IOProcess::(_processLogs) (14547) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,159::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,160::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,165::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,166::__init__::225::IOProcess::(_processLogs) Message size is 651 >Thread-25::DEBUG::2014-08-12 15:24:02,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,168::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,170::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,172::__init__::225::IOProcess::(_processLogs) (14548) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,174::__init__::225::IOProcess::(_processLogs) (14548) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,175::__init__::225::IOProcess::(_processLogs) (14548) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,176::__init__::225::IOProcess::(_processLogs) (14548) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,178::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,182::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,183::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,184::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,185::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,187::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,189::__init__::225::IOProcess::(_processLogs) (14549) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,190::__init__::225::IOProcess::(_processLogs) (14549) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,191::__init__::225::IOProcess::(_processLogs) (14549) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,192::__init__::225::IOProcess::(_processLogs) (14549) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,195::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >Thread-32::WARNING::2014-08-12 15:24:02,197::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,200::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,202::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:02,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,204::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,206::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,208::__init__::225::IOProcess::(_processLogs) (14550) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,209::__init__::225::IOProcess::(_processLogs) (14550) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,211::__init__::225::IOProcess::(_processLogs) (14550) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,212::__init__::225::IOProcess::(_processLogs) (14550) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,213::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,214::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::WARNING::2014-08-12 15:24:02,216::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,219::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,220::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:02,221::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,224::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,226::__init__::225::IOProcess::(_processLogs) (14551) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,228::__init__::225::IOProcess::(_processLogs) (14551) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,229::__init__::225::IOProcess::(_processLogs) (14551) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,230::__init__::225::IOProcess::(_processLogs) (14551) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,232::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,236::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,237::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,239::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,242::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,244::__init__::225::IOProcess::(_processLogs) (14552) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,245::__init__::225::IOProcess::(_processLogs) (14552) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,246::__init__::225::IOProcess::(_processLogs) (14552) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,247::__init__::225::IOProcess::(_processLogs) (14552) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,249::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,253::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,254::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:02,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,256::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,257::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,259::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,261::__init__::225::IOProcess::(_processLogs) (14553) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,262::__init__::225::IOProcess::(_processLogs) (14553) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:02,263::__init__::225::IOProcess::(_processLogs) (14553) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,264::__init__::225::IOProcess::(_processLogs) (14553) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,267::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,270::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,272::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:02,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,274::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,277::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,279::__init__::225::IOProcess::(_processLogs) (14554) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:02,280::__init__::225::IOProcess::(_processLogs) (14554) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:02,281::__init__::225::IOProcess::(_processLogs) (14554) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,282::__init__::225::IOProcess::(_processLogs) (14554) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,284::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:02,287::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job deleteImage_8b326e85-a567-45a3-801f-92819e343637 for task d9ae1b9a-2276-409c-99ef-2f0bb655b81d >Thread-32::INFO::2014-08-12 15:24:02,288::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-32::DEBUG::2014-08-12 15:24:02,289::task::1183::Storage.TaskManager.Task::(prepare) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::Prepare: 1 jobs exist, move to acquiring >Thread-32::DEBUG::2014-08-12 15:24:02,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::moving from state preparing -> state acquiring >Thread-25::DEBUG::2014-08-12 15:24:02,292::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,293::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:02,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,295::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,298::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,300::__init__::225::IOProcess::(_processLogs) (14555) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,301::__init__::225::IOProcess::(_processLogs) (14555) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,302::__init__::225::IOProcess::(_processLogs) (14555) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,303::__init__::225::IOProcess::(_processLogs) (14555) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,305::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:02,308::task::752::Storage.TaskManager.Task::(_save) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d.temp >Thread-25::DEBUG::2014-08-12 15:24:02,310::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,311::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,315::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,316::__init__::225::IOProcess::(_processLogs) (14556) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,316::__init__::225::IOProcess::(_processLogs) (14556) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,316::__init__::225::IOProcess::(_processLogs) (14556) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,316::__init__::225::IOProcess::(_processLogs) (14556) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,316::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,316::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,317::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,317::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,318::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,318::__init__::225::IOProcess::(_processLogs) (14557) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,318::__init__::225::IOProcess::(_processLogs) (14557) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,318::__init__::225::IOProcess::(_processLogs) (14557) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,319::__init__::225::IOProcess::(_processLogs) (14557) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,319::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,320::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,320::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:02,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,320::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,321::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,321::__init__::225::IOProcess::(_processLogs) (14558) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,321::__init__::225::IOProcess::(_processLogs) (14558) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,321::__init__::225::IOProcess::(_processLogs) (14558) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,321::__init__::225::IOProcess::(_processLogs) (14558) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,321::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,322::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,322::__init__::225::IOProcess::(_processLogs) Message size is 651 >Thread-25::DEBUG::2014-08-12 15:24:02,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,323::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,323::__init__::225::IOProcess::(_processLogs) (14559) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,324::__init__::225::IOProcess::(_processLogs) (14559) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,324::__init__::225::IOProcess::(_processLogs) (14559) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,324::__init__::225::IOProcess::(_processLogs) (14559) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,324::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,325::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,325::__init__::225::IOProcess::(_processLogs) Message size is 420 >Thread-25::DEBUG::2014-08-12 15:24:02,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,325::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,326::__init__::225::IOProcess::(_processLogs) (14560) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,326::__init__::225::IOProcess::(_processLogs) (14560) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,326::__init__::225::IOProcess::(_processLogs) (14560) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,327::__init__::225::IOProcess::(_processLogs) (14560) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,327::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,327::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,328::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,328::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,328::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,329::__init__::225::IOProcess::(_processLogs) (14561) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,329::__init__::225::IOProcess::(_processLogs) (14561) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,329::__init__::225::IOProcess::(_processLogs) (14561) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,329::__init__::225::IOProcess::(_processLogs) (14561) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,330::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >Thread-32::WARNING::2014-08-12 15:24:02,330::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,330::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,331::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:02,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,331::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,331::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,332::__init__::225::IOProcess::(_processLogs) (14562) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,332::__init__::225::IOProcess::(_processLogs) (14562) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,332::__init__::225::IOProcess::(_processLogs) (14562) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,332::__init__::225::IOProcess::(_processLogs) (14562) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,332::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::WARNING::2014-08-12 15:24:02,333::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,333::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,333::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:02,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,334::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,334::__init__::225::IOProcess::(_processLogs) (14563) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,335::__init__::225::IOProcess::(_processLogs) (14563) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,335::__init__::225::IOProcess::(_processLogs) (14563) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,335::__init__::225::IOProcess::(_processLogs) (14563) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,335::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,335::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,336::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,336::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,336::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,337::__init__::225::IOProcess::(_processLogs) (14564) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,337::__init__::225::IOProcess::(_processLogs) (14564) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,337::__init__::225::IOProcess::(_processLogs) (14564) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,337::__init__::225::IOProcess::(_processLogs) (14564) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,338::__init__::225::IOProcess::(_processLogs) Sending response sized 124 >Thread-25::DEBUG::2014-08-12 15:24:02,338::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,339::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-25::DEBUG::2014-08-12 15:24:02,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,339::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,339::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,340::__init__::225::IOProcess::(_processLogs) (14565) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:02,340::__init__::225::IOProcess::(_processLogs) (14565) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:02,340::__init__::225::IOProcess::(_processLogs) (14565) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,341::__init__::225::IOProcess::(_processLogs) (14565) Queuing response >Dummy-31::DEBUG::2014-08-12 15:24:02,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-25::DEBUG::2014-08-12 15:24:02,341::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,352::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:02,354::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,354::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-25::DEBUG::2014-08-12 15:24:02,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,355::__init__::225::IOProcess::(_processLogs) (14566) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:02,355::__init__::225::IOProcess::(_processLogs) (14566) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:02,355::__init__::225::IOProcess::(_processLogs) (14566) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,355::__init__::225::IOProcess::(_processLogs) (14566) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,355::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,356::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,356::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:02,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,357::__init__::225::IOProcess::(_processLogs) (14567) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,357::__init__::225::IOProcess::(_processLogs) (14567) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:02,357::__init__::225::IOProcess::(_processLogs) (14567) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,358::__init__::225::IOProcess::(_processLogs) (14567) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,358::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,359::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:02,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,359::__init__::225::IOProcess::(_processLogs) (14568) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:02,360::__init__::225::IOProcess::(_processLogs) (14568) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:02,360::__init__::225::IOProcess::(_processLogs) (14568) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,360::__init__::225::IOProcess::(_processLogs) (14568) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,360::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:02,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::moving from state acquiring -> state queued >Thread-25::DEBUG::2014-08-12 15:24:02,361::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:02,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,363::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,368::__init__::225::IOProcess::(_processLogs) (14569) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,369::__init__::225::IOProcess::(_processLogs) (14569) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,370::__init__::225::IOProcess::(_processLogs) (14569) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,371::__init__::225::IOProcess::(_processLogs) (14569) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,372::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:02,373::task::752::Storage.TaskManager.Task::(_save) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d.temp >Thread-25::DEBUG::2014-08-12 15:24:02,375::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-31::DEBUG::2014-08-12 15:24:02,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241434 s, 42.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:24:02,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,413::__init__::225::IOProcess::(_processLogs) (14570) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,413::__init__::225::IOProcess::(_processLogs) (14570) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,414::__init__::225::IOProcess::(_processLogs) (14570) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,414::__init__::225::IOProcess::(_processLogs) (14570) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,415::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,417::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,418::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,419::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,419::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,420::__init__::225::IOProcess::(_processLogs) (14571) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,420::__init__::225::IOProcess::(_processLogs) (14571) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,421::__init__::225::IOProcess::(_processLogs) (14571) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,421::__init__::225::IOProcess::(_processLogs) (14571) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,422::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,424::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:02,424::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,426::__init__::225::IOProcess::(_processLogs) (14572) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,427::__init__::225::IOProcess::(_processLogs) (14572) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,427::__init__::225::IOProcess::(_processLogs) (14572) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,428::__init__::225::IOProcess::(_processLogs) (14572) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,429::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,431::__init__::225::IOProcess::(_processLogs) Message size is 647 >Thread-25::DEBUG::2014-08-12 15:24:02,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,434::__init__::225::IOProcess::(_processLogs) (14573) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,434::__init__::225::IOProcess::(_processLogs) (14573) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,435::__init__::225::IOProcess::(_processLogs) (14573) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,435::__init__::225::IOProcess::(_processLogs) (14573) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,436::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,436::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,438::__init__::225::IOProcess::(_processLogs) Message size is 420 >Thread-25::DEBUG::2014-08-12 15:24:02,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,440::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,441::__init__::225::IOProcess::(_processLogs) (14574) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,441::__init__::225::IOProcess::(_processLogs) (14574) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,442::__init__::225::IOProcess::(_processLogs) (14574) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,442::__init__::225::IOProcess::(_processLogs) (14574) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,443::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,445::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,446::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,446::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,447::__init__::225::IOProcess::(_processLogs) (14575) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,448::__init__::225::IOProcess::(_processLogs) (14575) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,448::__init__::225::IOProcess::(_processLogs) (14575) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,449::__init__::225::IOProcess::(_processLogs) (14575) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,449::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,450::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >Thread-32::WARNING::2014-08-12 15:24:02,451::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,452::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:02,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,455::__init__::225::IOProcess::(_processLogs) (14576) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,456::__init__::225::IOProcess::(_processLogs) (14576) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,456::__init__::225::IOProcess::(_processLogs) (14576) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,456::__init__::225::IOProcess::(_processLogs) (14576) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,457::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::WARNING::2014-08-12 15:24:02,458::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,460::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,460::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:02,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,461::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,462::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,463::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,464::__init__::225::IOProcess::(_processLogs) (14577) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,465::__init__::225::IOProcess::(_processLogs) (14577) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,466::__init__::225::IOProcess::(_processLogs) (14577) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,467::__init__::225::IOProcess::(_processLogs) (14577) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,468::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,471::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,472::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,473::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,474::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,475::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,477::__init__::225::IOProcess::(_processLogs) (14578) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,478::__init__::225::IOProcess::(_processLogs) (14578) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,479::__init__::225::IOProcess::(_processLogs) (14578) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,480::__init__::225::IOProcess::(_processLogs) (14578) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,482::__init__::225::IOProcess::(_processLogs) Sending response sized 174 >Thread-25::DEBUG::2014-08-12 15:24:02,485::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:24:02,486::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-25::DEBUG::2014-08-12 15:24:02,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,487::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,491::__init__::225::IOProcess::(_processLogs) (14579) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:02,492::__init__::225::IOProcess::(_processLogs) (14579) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:02,492::__init__::225::IOProcess::(_processLogs) (14579) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,493::__init__::225::IOProcess::(_processLogs) (14579) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,495::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:02,499::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-25::DEBUG::2014-08-12 15:24:02,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,501::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,503::__init__::225::IOProcess::(_processLogs) (14580) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:02,504::__init__::225::IOProcess::(_processLogs) (14580) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:02,505::__init__::225::IOProcess::(_processLogs) (14580) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,506::__init__::225::IOProcess::(_processLogs) (14580) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,507::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,507::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,510::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-25::DEBUG::2014-08-12 15:24:02,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,514::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,515::__init__::225::IOProcess::(_processLogs) (14581) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:02,515::__init__::225::IOProcess::(_processLogs) (14581) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:02,516::__init__::225::IOProcess::(_processLogs) (14581) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,517::__init__::225::IOProcess::(_processLogs) (14581) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,519::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:02,523::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-25::DEBUG::2014-08-12 15:24:02,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,525::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,525::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,526::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,526::__init__::225::IOProcess::(_processLogs) (14582) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:02,527::__init__::225::IOProcess::(_processLogs) (14582) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:02,527::__init__::225::IOProcess::(_processLogs) (14582) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,528::__init__::225::IOProcess::(_processLogs) (14582) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,529::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,531::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:02,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,533::__init__::225::IOProcess::(_processLogs) (14583) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,534::__init__::225::IOProcess::(_processLogs) (14583) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:02,534::__init__::225::IOProcess::(_processLogs) (14583) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,534::__init__::225::IOProcess::(_processLogs) (14583) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,535::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,537::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:02,538::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,538::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:02,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,539::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,540::__init__::225::IOProcess::(_processLogs) (14584) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:02,540::__init__::225::IOProcess::(_processLogs) (14584) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:02,541::__init__::225::IOProcess::(_processLogs) (14584) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,541::__init__::225::IOProcess::(_processLogs) (14584) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,542::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:02,542::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: d9ae1b9a-2276-409c-99ef-2f0bb655b81d >Thread-32::DEBUG::2014-08-12 15:24:02,542::taskManager::64::Storage.TaskManager::(_queueTask) task queued: d9ae1b9a-2276-409c-99ef-2f0bb655b81d >49ee7910-c71c-4bc4-87d7-275f71db4d7a::DEBUG::2014-08-12 15:24:02,542::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-32::DEBUG::2014-08-12 15:24:02,543::task::1188::Storage.TaskManager.Task::(prepare) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::returning >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,544::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: d9ae1b9a-2276-409c-99ef-2f0bb655b81d running: <bound method Task.commit of <storage.task.Task instance at 0x7f32101ec248>> with: None >Thread-32::DEBUG::2014-08-12 15:24:02,544::task::993::Storage.TaskManager.Task::(_decref) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::ref 0 aborting False >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,545::task::1200::Storage.TaskManager.Task::(commit) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::committing task: d9ae1b9a-2276-409c-99ef-2f0bb655b81d >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::moving from state queued -> state running >Thread-25::DEBUG::2014-08-12 15:24:02,548::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:02,548::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,548::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,548::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,549::__init__::225::IOProcess::(_processLogs) (14585) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,549::__init__::225::IOProcess::(_processLogs) (14585) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,549::__init__::225::IOProcess::(_processLogs) (14585) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,549::__init__::225::IOProcess::(_processLogs) (14585) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,549::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,549::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,550::task::752::Storage.TaskManager.Task::(_save) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d.temp >Thread-25::DEBUG::2014-08-12 15:24:02,550::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,551::__init__::225::IOProcess::(_processLogs) (14586) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,551::__init__::225::IOProcess::(_processLogs) (14586) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,551::__init__::225::IOProcess::(_processLogs) (14586) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,551::__init__::225::IOProcess::(_processLogs) (14586) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,552::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,552::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,552::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,553::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,553::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,553::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,553::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,553::__init__::225::IOProcess::(_processLogs) (14587) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,553::__init__::225::IOProcess::(_processLogs) (14587) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,554::__init__::225::IOProcess::(_processLogs) (14587) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,554::__init__::225::IOProcess::(_processLogs) (14587) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,554::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,554::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,555::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:02,555::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,555::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,556::__init__::225::IOProcess::(_processLogs) (14588) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,556::__init__::225::IOProcess::(_processLogs) (14588) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,556::__init__::225::IOProcess::(_processLogs) (14588) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,556::__init__::225::IOProcess::(_processLogs) (14588) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,556::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,557::__init__::225::IOProcess::(_processLogs) Message size is 647 >Thread-25::DEBUG::2014-08-12 15:24:02,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,558::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,558::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,558::__init__::225::IOProcess::(_processLogs) (14589) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,558::__init__::225::IOProcess::(_processLogs) (14589) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,558::__init__::225::IOProcess::(_processLogs) (14589) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,558::__init__::225::IOProcess::(_processLogs) (14589) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,559::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,559::__init__::225::IOProcess::(_processLogs) Message size is 420 >Thread-25::DEBUG::2014-08-12 15:24:02,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,560::__init__::225::IOProcess::(_processLogs) (14590) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,560::__init__::225::IOProcess::(_processLogs) (14590) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,561::__init__::225::IOProcess::(_processLogs) (14590) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,561::__init__::225::IOProcess::(_processLogs) (14590) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,561::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,562::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,563::__init__::225::IOProcess::(_processLogs) (14591) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,563::__init__::225::IOProcess::(_processLogs) (14591) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,563::__init__::225::IOProcess::(_processLogs) (14591) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,563::__init__::225::IOProcess::(_processLogs) (14591) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,563::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,563::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::WARNING::2014-08-12 15:24:02,564::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,564::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:02,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,565::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,565::__init__::225::IOProcess::(_processLogs) (14592) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,565::__init__::225::IOProcess::(_processLogs) (14592) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,565::__init__::225::IOProcess::(_processLogs) (14592) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,566::__init__::225::IOProcess::(_processLogs) (14592) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,566::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,566::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::WARNING::2014-08-12 15:24:02,566::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,567::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:02,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,568::__init__::225::IOProcess::(_processLogs) (14593) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,568::__init__::225::IOProcess::(_processLogs) (14593) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,568::__init__::225::IOProcess::(_processLogs) (14593) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,568::__init__::225::IOProcess::(_processLogs) (14593) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,568::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,568::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,569::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,569::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,570::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,570::__init__::225::IOProcess::(_processLogs) (14594) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,570::__init__::225::IOProcess::(_processLogs) (14594) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,570::__init__::225::IOProcess::(_processLogs) (14594) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,570::__init__::225::IOProcess::(_processLogs) (14594) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,571::__init__::225::IOProcess::(_processLogs) Sending response sized 174 >Thread-25::DEBUG::2014-08-12 15:24:02,571::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-25::DEBUG::2014-08-12 15:24:02,572::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,572::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,572::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,572::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,572::__init__::225::IOProcess::(_processLogs) (14595) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:02,572::__init__::225::IOProcess::(_processLogs) (14595) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:02,572::__init__::225::IOProcess::(_processLogs) (14595) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,573::__init__::225::IOProcess::(_processLogs) (14595) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,573::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,573::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:02,574::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-25::DEBUG::2014-08-12 15:24:02,574::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,574::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,575::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,575::__init__::225::IOProcess::(_processLogs) (14596) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:02,575::__init__::225::IOProcess::(_processLogs) (14596) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:02,575::__init__::225::IOProcess::(_processLogs) (14596) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,575::__init__::225::IOProcess::(_processLogs) (14596) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,575::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,576::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-25::DEBUG::2014-08-12 15:24:02,576::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,577::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,577::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,577::__init__::225::IOProcess::(_processLogs) (14597) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:02,577::__init__::225::IOProcess::(_processLogs) (14597) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:02,577::__init__::225::IOProcess::(_processLogs) (14597) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,577::__init__::225::IOProcess::(_processLogs) (14597) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,578::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,578::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:02,579::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-25::DEBUG::2014-08-12 15:24:02,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,579::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,579::__init__::225::IOProcess::(_processLogs) (14598) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:02,580::__init__::225::IOProcess::(_processLogs) (14598) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:02,580::__init__::225::IOProcess::(_processLogs) (14598) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,580::__init__::225::IOProcess::(_processLogs) (14598) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,580::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,581::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:02,581::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,581::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,582::__init__::225::IOProcess::(_processLogs) (14599) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,582::__init__::225::IOProcess::(_processLogs) (14599) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:02,582::__init__::225::IOProcess::(_processLogs) (14599) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,582::__init__::225::IOProcess::(_processLogs) (14599) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,582::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,583::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:02,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,584::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,584::__init__::225::IOProcess::(_processLogs) (14600) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:02,584::__init__::225::IOProcess::(_processLogs) (14600) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:02,584::__init__::225::IOProcess::(_processLogs) (14600) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,584::__init__::225::IOProcess::(_processLogs) (14600) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,585::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,585::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,585::task::905::Storage.TaskManager.Task::(_runJobs) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::Task.run: running job 0: deleteImage_8b326e85-a567-45a3-801f-92819e343637: <function <lambda> at 0x7f32045468c0> (args: () kwargs: {}) >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,585::task::331::Storage.TaskManager.Task::(run) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::Job.run: running deleteImage_8b326e85-a567-45a3-801f-92819e343637: <function <lambda> at 0x7f32045468c0> (args: () kwargs: {}) callback None >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::moving from state running -> state finished >Thread-25::DEBUG::2014-08-12 15:24:02,586::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:02,586::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,587::__init__::225::IOProcess::(_processLogs) (14601) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,587::__init__::225::IOProcess::(_processLogs) (14601) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,587::__init__::225::IOProcess::(_processLogs) (14601) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,587::__init__::225::IOProcess::(_processLogs) (14601) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,587::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,588::task::752::Storage.TaskManager.Task::(_save) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/d9ae1b9a-2276-409c-99ef-2f0bb655b81d.temp >Thread-25::DEBUG::2014-08-12 15:24:02,588::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,589::__init__::225::IOProcess::(_processLogs) (14602) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,589::__init__::225::IOProcess::(_processLogs) (14602) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,589::__init__::225::IOProcess::(_processLogs) (14602) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,590::__init__::225::IOProcess::(_processLogs) (14602) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,590::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,591::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:02,591::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,591::__init__::225::IOProcess::(_processLogs) (14603) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:02,592::__init__::225::IOProcess::(_processLogs) (14603) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:02,592::__init__::225::IOProcess::(_processLogs) (14603) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,592::__init__::225::IOProcess::(_processLogs) (14603) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,592::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:02,593::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:02,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,593::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,594::__init__::225::IOProcess::(_processLogs) (14604) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,594::__init__::225::IOProcess::(_processLogs) (14604) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:02,594::__init__::225::IOProcess::(_processLogs) (14604) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,594::__init__::225::IOProcess::(_processLogs) (14604) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,594::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,595::__init__::225::IOProcess::(_processLogs) Message size is 651 >Thread-25::DEBUG::2014-08-12 15:24:02,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,596::__init__::225::IOProcess::(_processLogs) (14605) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,596::__init__::225::IOProcess::(_processLogs) (14605) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,596::__init__::225::IOProcess::(_processLogs) (14605) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,597::__init__::225::IOProcess::(_processLogs) (14605) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,597::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,598::__init__::225::IOProcess::(_processLogs) Message size is 337 >Thread-25::DEBUG::2014-08-12 15:24:02,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,598::__init__::225::IOProcess::(_processLogs) (14606) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,599::__init__::225::IOProcess::(_processLogs) (14606) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,599::__init__::225::IOProcess::(_processLogs) (14606) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,599::__init__::225::IOProcess::(_processLogs) (14606) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,599::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,600::__init__::225::IOProcess::(_processLogs) Message size is 420 >Thread-25::DEBUG::2014-08-12 15:24:02,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,601::__init__::225::IOProcess::(_processLogs) (14607) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:02,601::__init__::225::IOProcess::(_processLogs) (14607) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:02,601::__init__::225::IOProcess::(_processLogs) (14607) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,601::__init__::225::IOProcess::(_processLogs) (14607) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,601::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:02,602::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,603::__init__::225::IOProcess::(_processLogs) (14608) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,603::__init__::225::IOProcess::(_processLogs) (14608) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,603::__init__::225::IOProcess::(_processLogs) (14608) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,603::__init__::225::IOProcess::(_processLogs) (14608) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,603::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,604::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::WARNING::2014-08-12 15:24:02,604::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,604::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:02,605::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,605::__init__::225::IOProcess::(_processLogs) (14609) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,605::__init__::225::IOProcess::(_processLogs) (14609) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,606::__init__::225::IOProcess::(_processLogs) (14609) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,606::__init__::225::IOProcess::(_processLogs) (14609) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,606::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::WARNING::2014-08-12 15:24:02,606::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:02,607::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:02,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,608::__init__::225::IOProcess::(_processLogs) (14610) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:02,608::__init__::225::IOProcess::(_processLogs) (14610) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:02,608::__init__::225::IOProcess::(_processLogs) (14610) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,608::__init__::225::IOProcess::(_processLogs) (14610) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,608::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,609::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:02,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,610::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,610::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,610::__init__::225::IOProcess::(_processLogs) (14611) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,610::__init__::225::IOProcess::(_processLogs) (14611) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:02,610::__init__::225::IOProcess::(_processLogs) (14611) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,610::__init__::225::IOProcess::(_processLogs) (14611) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,611::__init__::225::IOProcess::(_processLogs) Sending response sized 174 >Thread-25::DEBUG::2014-08-12 15:24:02,611::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-25::DEBUG::2014-08-12 15:24:02,612::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,612::__init__::225::IOProcess::(_processLogs) (14612) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:02,612::__init__::225::IOProcess::(_processLogs) (14612) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:02,613::__init__::225::IOProcess::(_processLogs) (14612) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,613::__init__::225::IOProcess::(_processLogs) (14612) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,613::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:02,614::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-25::DEBUG::2014-08-12 15:24:02,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,615::__init__::225::IOProcess::(_processLogs) (14613) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:02,615::__init__::225::IOProcess::(_processLogs) (14613) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:02,615::__init__::225::IOProcess::(_processLogs) (14613) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,615::__init__::225::IOProcess::(_processLogs) (14613) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,615::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,616::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-25::DEBUG::2014-08-12 15:24:02,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,617::__init__::225::IOProcess::(_processLogs) (14614) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:02,617::__init__::225::IOProcess::(_processLogs) (14614) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:02,617::__init__::225::IOProcess::(_processLogs) (14614) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,617::__init__::225::IOProcess::(_processLogs) (14614) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,618::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,618::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:02,619::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-25::DEBUG::2014-08-12 15:24:02,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,619::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,619::__init__::225::IOProcess::(_processLogs) (14615) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:02,620::__init__::225::IOProcess::(_processLogs) (14615) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:02,620::__init__::225::IOProcess::(_processLogs) (14615) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,620::__init__::225::IOProcess::(_processLogs) (14615) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,620::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,621::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:02,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,622::__init__::225::IOProcess::(_processLogs) (14616) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:02,622::__init__::225::IOProcess::(_processLogs) (14616) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:02,622::__init__::225::IOProcess::(_processLogs) (14616) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,622::__init__::225::IOProcess::(_processLogs) (14616) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,622::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:02,624::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:02,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:02,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:02,624::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:02,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:02,624::__init__::225::IOProcess::(_processLogs) (14617) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:02,624::__init__::225::IOProcess::(_processLogs) (14617) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:02,625::__init__::225::IOProcess::(_processLogs) (14617) Building response >Thread-25::DEBUG::2014-08-12 15:24:02,625::__init__::225::IOProcess::(_processLogs) (14617) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:02,625::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:02,625::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>, 'Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>} >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,626::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,626::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,626::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,626::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,627::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf' >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,627::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,627::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,627::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.8b326e85-a567-45a3-801f-92819e343637_180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,627::task::916::Storage.TaskManager.Task::(_runJobs) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::Task.run: exit - success: result True >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,628::task::993::Storage.TaskManager.Task::(_decref) Task=`d9ae1b9a-2276-409c-99ef-2f0bb655b81d`::ref 0 aborting False >d9ae1b9a-2276-409c-99ef-2f0bb655b81d::DEBUG::2014-08-12 15:24:02,628::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-14::DEBUG::2014-08-12 15:24:03,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfb8cc08-4be2-485d-b8f6-de73237ec2bf`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:03,764::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:24:03,764::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609302', 'lastCheck': '4.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685205', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:24:03,764::task::1191::Storage.TaskManager.Task::(prepare) Task=`bfb8cc08-4be2-485d-b8f6-de73237ec2bf`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609302', 'lastCheck': '4.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685205', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:24:03,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfb8cc08-4be2-485d-b8f6-de73237ec2bf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:03,765::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:03,765::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:03,765::task::993::Storage.TaskManager.Task::(_decref) Task=`bfb8cc08-4be2-485d-b8f6-de73237ec2bf`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:24:03,910::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:04,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:04,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133148 s, 76.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:05,068::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:05,069::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:05,070::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-32::DEBUG::2014-08-12 15:24:06,458::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [48a82b0c] >Thread-32::DEBUG::2014-08-12 15:24:06,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:24:06,459::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='9c06af0f-2451-41f1-a031-d08c4950266d', postZero='false', force='false') >Thread-32::DEBUG::2014-08-12 15:24:06,459::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`416606d7-9283-4e05-b5c2-7d38e3cb302d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1497' at 'deleteImage' >Thread-32::DEBUG::2014-08-12 15:24:06,460::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'exclusive' >Thread-32::DEBUG::2014-08-12 15:24:06,460::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'exclusive' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:06,460::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`416606d7-9283-4e05-b5c2-7d38e3cb302d`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:06,460::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::_resourcesAcquired: Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf (exclusive) >Thread-32::DEBUG::2014-08-12 15:24:06,461::task::993::Storage.TaskManager.Task::(_decref) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::ref 1 aborting False >Thread-32::DEBUG::2014-08-12 15:24:06,461::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`cf225afe-810d-4666-b135-ef8bf13ecb77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1498' at 'deleteImage' >Thread-32::DEBUG::2014-08-12 15:24:06,461::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:24:06,461::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:06,461::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`cf225afe-810d-4666-b135-ef8bf13ecb77`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:06,462::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::_resourcesAcquired: Storage.180aea8f-26ba-4e87-8a94-37d5469519bf (shared) >Thread-32::DEBUG::2014-08-12 15:24:06,462::task::993::Storage.TaskManager.Task::(_decref) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::ref 1 aborting False >Thread-32::DEBUG::2014-08-12 15:24:06,462::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:06,463::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:06,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:06,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129242 s, 79.2 MB/s\n'; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:24:06,710::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:24:06,711::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-32::DEBUG::2014-08-12 15:24:06,711::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:06,712::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --autobackup n -a y --deltag IU_9c06af0f-2451-41f1-a031-d08c4950266d --addtag IU__remove_me_9c06af0f-2451-41f1-a031-d08c4950266d 180aea8f-26ba-4e87-8a94-37d5469519bf/4f65bc56-87ae-4b08-aa65-75103525d7ef 180aea8f-26ba-4e87-8a94-37d5469519bf/1d7d814c-7bad-4412-8e95-d178dd18f223 180aea8f-26ba-4e87-8a94-37d5469519bf/eaf69f9d-59f2-4c3f-9795-cf3a71045db6 180aea8f-26ba-4e87-8a94-37d5469519bf/7bc4d940-6844-4473-aded-d04d3afc89f7 (cwd None) >Thread-32::DEBUG::2014-08-12 15:24:07,157::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:24:07,157::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,158::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::WARNING::2014-08-12 15:24:07,158::lvm::1087::Storage.LVM::(removeLVs) Removing active volume 180aea8f-26ba-4e87-8a94-37d5469519bf/4f65bc56-87ae-4b08-aa65-75103525d7ef >Thread-32::WARNING::2014-08-12 15:24:07,158::lvm::1087::Storage.LVM::(removeLVs) Removing active volume 180aea8f-26ba-4e87-8a94-37d5469519bf/1d7d814c-7bad-4412-8e95-d178dd18f223 >Thread-32::WARNING::2014-08-12 15:24:07,158::lvm::1087::Storage.LVM::(removeLVs) Removing active volume 180aea8f-26ba-4e87-8a94-37d5469519bf/eaf69f9d-59f2-4c3f-9795-cf3a71045db6 >Thread-32::WARNING::2014-08-12 15:24:07,158::lvm::1087::Storage.LVM::(removeLVs) Removing active volume 180aea8f-26ba-4e87-8a94-37d5469519bf/7bc4d940-6844-4473-aded-d04d3afc89f7 >Thread-32::DEBUG::2014-08-12 15:24:07,159::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvremove --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' -f --autobackup n 180aea8f-26ba-4e87-8a94-37d5469519bf/4f65bc56-87ae-4b08-aa65-75103525d7ef 180aea8f-26ba-4e87-8a94-37d5469519bf/1d7d814c-7bad-4412-8e95-d178dd18f223 180aea8f-26ba-4e87-8a94-37d5469519bf/eaf69f9d-59f2-4c3f-9795-cf3a71045db6 180aea8f-26ba-4e87-8a94-37d5469519bf/7bc4d940-6844-4473-aded-d04d3afc89f7 (cwd None) >Thread-32::DEBUG::2014-08-12 15:24:07,455::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-32::DEBUG::2014-08-12 15:24:07,455::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,455::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,456::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,456::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,456::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,456::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,457::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,457::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-32::DEBUG::2014-08-12 15:24:07,457::blockSD::946::Storage.StorageDomain::(rmDCVolLinks) removed: ['/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d/7bc4d940-6844-4473-aded-d04d3afc89f7'] >Thread-32::DEBUG::2014-08-12 15:24:07,457::blockSD::957::Storage.StorageDomain::(rmDCImgDir) removed image dir: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/9c06af0f-2451-41f1-a031-d08c4950266d >Thread-25::DEBUG::2014-08-12 15:24:07,458::__init__::225::IOProcess::(_processLogs) Message size is 72 >Thread-25::DEBUG::2014-08-12 15:24:07,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,459::__init__::225::IOProcess::(_processLogs) (14618) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,459::__init__::225::IOProcess::(_processLogs) (14618) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,459::__init__::225::IOProcess::(_processLogs) (14618) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,460::__init__::225::IOProcess::(_processLogs) (14618) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,460::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:07,461::__init__::225::IOProcess::(_processLogs) Message size is 76 >Thread-25::DEBUG::2014-08-12 15:24:07,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,462::__init__::225::IOProcess::(_processLogs) (14619) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,462::__init__::225::IOProcess::(_processLogs) (14619) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,462::__init__::225::IOProcess::(_processLogs) (14619) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,462::__init__::225::IOProcess::(_processLogs) (14619) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,462::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,462::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:07,463::__init__::225::IOProcess::(_processLogs) Message size is 88 >Thread-25::DEBUG::2014-08-12 15:24:07,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,464::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,464::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,464::__init__::225::IOProcess::(_processLogs) (14620) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,464::__init__::225::IOProcess::(_processLogs) (14620) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,465::__init__::225::IOProcess::(_processLogs) (14620) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,465::__init__::225::IOProcess::(_processLogs) (14620) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,465::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,465::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:07,466::__init__::225::IOProcess::(_processLogs) Message size is 125 >Thread-25::DEBUG::2014-08-12 15:24:07,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,466::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,467::__init__::225::IOProcess::(_processLogs) (14621) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,467::__init__::225::IOProcess::(_processLogs) (14621) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,467::__init__::225::IOProcess::(_processLogs) (14621) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,467::__init__::225::IOProcess::(_processLogs) (14621) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,467::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,467::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:07,468::__init__::225::IOProcess::(_processLogs) Message size is 134 >Thread-25::DEBUG::2014-08-12 15:24:07,468::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,469::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,469::__init__::225::IOProcess::(_processLogs) (14622) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,469::__init__::225::IOProcess::(_processLogs) (14622) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,469::__init__::225::IOProcess::(_processLogs) (14622) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,470::__init__::225::IOProcess::(_processLogs) (14622) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,470::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,470::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:07,471::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-25::DEBUG::2014-08-12 15:24:07,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,471::__init__::225::IOProcess::(_processLogs) (14623) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,472::__init__::225::IOProcess::(_processLogs) (14623) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,472::__init__::225::IOProcess::(_processLogs) (14623) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,472::__init__::225::IOProcess::(_processLogs) (14623) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,472::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:07,473::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:24:07,473::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,473::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,474::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,474::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,474::__init__::225::IOProcess::(_processLogs) (14624) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,474::__init__::225::IOProcess::(_processLogs) (14624) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,474::__init__::225::IOProcess::(_processLogs) (14624) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,474::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,475::__init__::225::IOProcess::(_processLogs) Sending response sized 81 >Thread-25::DEBUG::2014-08-12 15:24:07,475::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-25::DEBUG::2014-08-12 15:24:07,475::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,476::__init__::225::IOProcess::(_processLogs) (14625) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,476::__init__::225::IOProcess::(_processLogs) (14625) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,476::__init__::225::IOProcess::(_processLogs) (14625) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,477::__init__::225::IOProcess::(_processLogs) (14625) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,477::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,478::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:07,478::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,479::__init__::225::IOProcess::(_processLogs) (14626) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,479::__init__::225::IOProcess::(_processLogs) (14626) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,479::__init__::225::IOProcess::(_processLogs) (14626) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,479::__init__::225::IOProcess::(_processLogs) (14626) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,479::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,479::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:07,480::task::752::Storage.TaskManager.Task::(_save) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e.temp >Thread-25::DEBUG::2014-08-12 15:24:07,480::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,480::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,481::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,481::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,481::__init__::225::IOProcess::(_processLogs) (14627) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,481::__init__::225::IOProcess::(_processLogs) (14627) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,481::__init__::225::IOProcess::(_processLogs) (14627) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,482::__init__::225::IOProcess::(_processLogs) (14627) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,482::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,483::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,483::__init__::225::IOProcess::(_processLogs) (14628) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,484::__init__::225::IOProcess::(_processLogs) (14628) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,484::__init__::225::IOProcess::(_processLogs) (14628) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,484::__init__::225::IOProcess::(_processLogs) (14628) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,484::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,484::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,485::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:07,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,485::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,486::__init__::225::IOProcess::(_processLogs) (14629) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,486::__init__::225::IOProcess::(_processLogs) (14629) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,486::__init__::225::IOProcess::(_processLogs) (14629) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,486::__init__::225::IOProcess::(_processLogs) (14629) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,486::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,486::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,487::__init__::225::IOProcess::(_processLogs) Message size is 651 >Thread-25::DEBUG::2014-08-12 15:24:07,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,488::__init__::225::IOProcess::(_processLogs) (14630) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,488::__init__::225::IOProcess::(_processLogs) (14630) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,488::__init__::225::IOProcess::(_processLogs) (14630) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,489::__init__::225::IOProcess::(_processLogs) (14630) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,489::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,490::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,490::__init__::225::IOProcess::(_processLogs) (14631) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,491::__init__::225::IOProcess::(_processLogs) (14631) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,491::__init__::225::IOProcess::(_processLogs) (14631) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,491::__init__::225::IOProcess::(_processLogs) (14631) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,491::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >Thread-32::WARNING::2014-08-12 15:24:07,492::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,492::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:07,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,493::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,493::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,493::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,493::__init__::225::IOProcess::(_processLogs) (14632) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,493::__init__::225::IOProcess::(_processLogs) (14632) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,493::__init__::225::IOProcess::(_processLogs) (14632) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,493::__init__::225::IOProcess::(_processLogs) (14632) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,494::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::WARNING::2014-08-12 15:24:07,494::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,495::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:07,495::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,495::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,495::__init__::225::IOProcess::(_processLogs) (14633) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,496::__init__::225::IOProcess::(_processLogs) (14633) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,496::__init__::225::IOProcess::(_processLogs) (14633) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,496::__init__::225::IOProcess::(_processLogs) (14633) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,496::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,497::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,497::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,498::__init__::225::IOProcess::(_processLogs) (14634) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,498::__init__::225::IOProcess::(_processLogs) (14634) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,498::__init__::225::IOProcess::(_processLogs) (14634) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,498::__init__::225::IOProcess::(_processLogs) (14634) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,498::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,499::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,499::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:07,499::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,500::__init__::225::IOProcess::(_processLogs) (14635) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,500::__init__::225::IOProcess::(_processLogs) (14635) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:07,500::__init__::225::IOProcess::(_processLogs) (14635) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,501::__init__::225::IOProcess::(_processLogs) (14635) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,501::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,502::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:07,502::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,502::__init__::225::IOProcess::(_processLogs) (14636) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:07,503::__init__::225::IOProcess::(_processLogs) (14636) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:07,503::__init__::225::IOProcess::(_processLogs) (14636) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,503::__init__::225::IOProcess::(_processLogs) (14636) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,503::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,503::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:07,504::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job deleteImage_9c06af0f-2451-41f1-a031-d08c4950266d for task 94b41d4f-e515-49b8-9284-c5994008483e >Thread-32::INFO::2014-08-12 15:24:07,504::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-32::DEBUG::2014-08-12 15:24:07,504::task::1183::Storage.TaskManager.Task::(prepare) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::Prepare: 1 jobs exist, move to acquiring >Thread-32::DEBUG::2014-08-12 15:24:07,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::moving from state preparing -> state acquiring >Thread-25::DEBUG::2014-08-12 15:24:07,504::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:07,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,505::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,505::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,505::__init__::225::IOProcess::(_processLogs) (14637) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,505::__init__::225::IOProcess::(_processLogs) (14637) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,506::__init__::225::IOProcess::(_processLogs) (14637) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,506::__init__::225::IOProcess::(_processLogs) (14637) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,506::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,506::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:07,507::task::752::Storage.TaskManager.Task::(_save) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e.temp >Thread-25::DEBUG::2014-08-12 15:24:07,507::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,508::__init__::225::IOProcess::(_processLogs) (14638) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,508::__init__::225::IOProcess::(_processLogs) (14638) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,508::__init__::225::IOProcess::(_processLogs) (14638) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,508::__init__::225::IOProcess::(_processLogs) (14638) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,509::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,509::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,509::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,510::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,510::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,510::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,510::__init__::225::IOProcess::(_processLogs) (14639) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,510::__init__::225::IOProcess::(_processLogs) (14639) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,510::__init__::225::IOProcess::(_processLogs) (14639) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,511::__init__::225::IOProcess::(_processLogs) (14639) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,511::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,512::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:07,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,512::__init__::225::IOProcess::(_processLogs) (14640) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,513::__init__::225::IOProcess::(_processLogs) (14640) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,513::__init__::225::IOProcess::(_processLogs) (14640) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,513::__init__::225::IOProcess::(_processLogs) (14640) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,513::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,513::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,514::__init__::225::IOProcess::(_processLogs) Message size is 651 >Thread-25::DEBUG::2014-08-12 15:24:07,514::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,514::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,514::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,515::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,515::__init__::225::IOProcess::(_processLogs) (14641) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,515::__init__::225::IOProcess::(_processLogs) (14641) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,515::__init__::225::IOProcess::(_processLogs) (14641) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,515::__init__::225::IOProcess::(_processLogs) (14641) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,515::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,516::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,516::__init__::225::IOProcess::(_processLogs) Message size is 420 >Thread-25::DEBUG::2014-08-12 15:24:07,517::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,517::__init__::225::IOProcess::(_processLogs) (14642) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,517::__init__::225::IOProcess::(_processLogs) (14642) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,518::__init__::225::IOProcess::(_processLogs) (14642) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,518::__init__::225::IOProcess::(_processLogs) (14642) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,518::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,519::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,519::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,519::__init__::225::IOProcess::(_processLogs) (14643) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,520::__init__::225::IOProcess::(_processLogs) (14643) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,520::__init__::225::IOProcess::(_processLogs) (14643) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,520::__init__::225::IOProcess::(_processLogs) (14643) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,520::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,520::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >Thread-32::WARNING::2014-08-12 15:24:07,521::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,521::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:07,521::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,522::__init__::225::IOProcess::(_processLogs) (14644) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,522::__init__::225::IOProcess::(_processLogs) (14644) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,522::__init__::225::IOProcess::(_processLogs) (14644) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,522::__init__::225::IOProcess::(_processLogs) (14644) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,523::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::WARNING::2014-08-12 15:24:07,523::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,524::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:07,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,524::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,524::__init__::225::IOProcess::(_processLogs) (14645) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,525::__init__::225::IOProcess::(_processLogs) (14645) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,525::__init__::225::IOProcess::(_processLogs) (14645) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,525::__init__::225::IOProcess::(_processLogs) (14645) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,525::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,526::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,526::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,526::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,527::__init__::225::IOProcess::(_processLogs) (14646) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,527::__init__::225::IOProcess::(_processLogs) (14646) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,527::__init__::225::IOProcess::(_processLogs) (14646) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,527::__init__::225::IOProcess::(_processLogs) (14646) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,527::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,527::__init__::225::IOProcess::(_processLogs) Sending response sized 124 >Thread-25::DEBUG::2014-08-12 15:24:07,528::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-25::DEBUG::2014-08-12 15:24:07,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,529::__init__::225::IOProcess::(_processLogs) (14647) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,529::__init__::225::IOProcess::(_processLogs) (14647) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,529::__init__::225::IOProcess::(_processLogs) (14647) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,529::__init__::225::IOProcess::(_processLogs) (14647) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,530::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,531::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-25::DEBUG::2014-08-12 15:24:07,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,532::__init__::225::IOProcess::(_processLogs) (14648) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,532::__init__::225::IOProcess::(_processLogs) (14648) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,532::__init__::225::IOProcess::(_processLogs) (14648) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,532::__init__::225::IOProcess::(_processLogs) (14648) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,532::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,532::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,533::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:07,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,534::__init__::225::IOProcess::(_processLogs) (14649) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,534::__init__::225::IOProcess::(_processLogs) (14649) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:07,534::__init__::225::IOProcess::(_processLogs) (14649) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,534::__init__::225::IOProcess::(_processLogs) (14649) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,535::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,535::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:07,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,536::__init__::225::IOProcess::(_processLogs) (14650) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:07,536::__init__::225::IOProcess::(_processLogs) (14650) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:07,536::__init__::225::IOProcess::(_processLogs) (14650) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,537::__init__::225::IOProcess::(_processLogs) (14650) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,537::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:07,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::moving from state acquiring -> state queued >Thread-25::DEBUG::2014-08-12 15:24:07,538::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:07,538::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,539::__init__::225::IOProcess::(_processLogs) (14651) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,539::__init__::225::IOProcess::(_processLogs) (14651) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,539::__init__::225::IOProcess::(_processLogs) (14651) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,539::__init__::225::IOProcess::(_processLogs) (14651) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,539::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,539::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:07,540::task::752::Storage.TaskManager.Task::(_save) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e.temp >Thread-25::DEBUG::2014-08-12 15:24:07,540::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,541::__init__::225::IOProcess::(_processLogs) (14652) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,541::__init__::225::IOProcess::(_processLogs) (14652) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,541::__init__::225::IOProcess::(_processLogs) (14652) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,541::__init__::225::IOProcess::(_processLogs) (14652) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,542::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,542::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,543::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,543::__init__::225::IOProcess::(_processLogs) (14653) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,543::__init__::225::IOProcess::(_processLogs) (14653) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,544::__init__::225::IOProcess::(_processLogs) (14653) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,544::__init__::225::IOProcess::(_processLogs) (14653) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,544::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,545::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:07,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,545::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,545::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,545::__init__::225::IOProcess::(_processLogs) (14654) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,546::__init__::225::IOProcess::(_processLogs) (14654) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,546::__init__::225::IOProcess::(_processLogs) (14654) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,546::__init__::225::IOProcess::(_processLogs) (14654) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,546::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,547::__init__::225::IOProcess::(_processLogs) Message size is 647 >Thread-25::DEBUG::2014-08-12 15:24:07,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,548::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,548::__init__::225::IOProcess::(_processLogs) (14655) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,548::__init__::225::IOProcess::(_processLogs) (14655) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,548::__init__::225::IOProcess::(_processLogs) (14655) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,548::__init__::225::IOProcess::(_processLogs) (14655) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,549::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,549::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,549::__init__::225::IOProcess::(_processLogs) Message size is 420 >Thread-25::DEBUG::2014-08-12 15:24:07,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,550::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,550::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,550::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,550::__init__::225::IOProcess::(_processLogs) (14656) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,550::__init__::225::IOProcess::(_processLogs) (14656) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,551::__init__::225::IOProcess::(_processLogs) (14656) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,551::__init__::225::IOProcess::(_processLogs) (14656) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,551::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,552::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,552::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,553::__init__::225::IOProcess::(_processLogs) (14657) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,553::__init__::225::IOProcess::(_processLogs) (14657) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,553::__init__::225::IOProcess::(_processLogs) (14657) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,553::__init__::225::IOProcess::(_processLogs) (14657) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,553::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,553::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >Thread-32::WARNING::2014-08-12 15:24:07,554::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,554::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:07,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,555::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,555::__init__::225::IOProcess::(_processLogs) (14658) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,555::__init__::225::IOProcess::(_processLogs) (14658) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,555::__init__::225::IOProcess::(_processLogs) (14658) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,555::__init__::225::IOProcess::(_processLogs) (14658) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,556::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::WARNING::2014-08-12 15:24:07,556::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,557::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:07,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,557::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,557::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,557::__init__::225::IOProcess::(_processLogs) (14659) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,558::__init__::225::IOProcess::(_processLogs) (14659) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,558::__init__::225::IOProcess::(_processLogs) (14659) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,558::__init__::225::IOProcess::(_processLogs) (14659) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,558::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,559::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,559::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,560::__init__::225::IOProcess::(_processLogs) (14660) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,560::__init__::225::IOProcess::(_processLogs) (14660) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,560::__init__::225::IOProcess::(_processLogs) (14660) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,560::__init__::225::IOProcess::(_processLogs) (14660) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,560::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,560::__init__::225::IOProcess::(_processLogs) Sending response sized 174 >Thread-25::DEBUG::2014-08-12 15:24:07,561::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-25::DEBUG::2014-08-12 15:24:07,561::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,562::__init__::225::IOProcess::(_processLogs) (14661) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,562::__init__::225::IOProcess::(_processLogs) (14661) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,562::__init__::225::IOProcess::(_processLogs) (14661) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,562::__init__::225::IOProcess::(_processLogs) (14661) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,563::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,563::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,564::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-25::DEBUG::2014-08-12 15:24:07,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,564::__init__::225::IOProcess::(_processLogs) (14662) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,565::__init__::225::IOProcess::(_processLogs) (14662) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,565::__init__::225::IOProcess::(_processLogs) (14662) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,565::__init__::225::IOProcess::(_processLogs) (14662) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,565::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,566::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-25::DEBUG::2014-08-12 15:24:07,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,567::__init__::225::IOProcess::(_processLogs) (14663) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,567::__init__::225::IOProcess::(_processLogs) (14663) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,567::__init__::225::IOProcess::(_processLogs) (14663) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,567::__init__::225::IOProcess::(_processLogs) (14663) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,567::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,568::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-25::DEBUG::2014-08-12 15:24:07,569::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,569::__init__::225::IOProcess::(_processLogs) (14664) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,569::__init__::225::IOProcess::(_processLogs) (14664) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,570::__init__::225::IOProcess::(_processLogs) (14664) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,570::__init__::225::IOProcess::(_processLogs) (14664) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,570::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,571::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:07,571::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,571::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,571::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,571::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,571::__init__::225::IOProcess::(_processLogs) (14665) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,572::__init__::225::IOProcess::(_processLogs) (14665) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:07,572::__init__::225::IOProcess::(_processLogs) (14665) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,572::__init__::225::IOProcess::(_processLogs) (14665) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,572::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,572::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,573::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:07,573::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,573::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,573::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,574::__init__::225::IOProcess::(_processLogs) (14666) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:07,574::__init__::225::IOProcess::(_processLogs) (14666) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:07,574::__init__::225::IOProcess::(_processLogs) (14666) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,574::__init__::225::IOProcess::(_processLogs) (14666) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,574::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,574::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:07,575::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: 94b41d4f-e515-49b8-9284-c5994008483e >Thread-32::DEBUG::2014-08-12 15:24:07,575::taskManager::64::Storage.TaskManager::(_queueTask) task queued: 94b41d4f-e515-49b8-9284-c5994008483e >f3068708-17f9-415a-85a4-b45e2412b4a5::DEBUG::2014-08-12 15:24:07,575::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-32::DEBUG::2014-08-12 15:24:07,576::task::1188::Storage.TaskManager.Task::(prepare) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::returning >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,576::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: 94b41d4f-e515-49b8-9284-c5994008483e running: <bound method Task.commit of <storage.task.Task instance at 0x7f323c3ff830>> with: None >Thread-32::DEBUG::2014-08-12 15:24:07,577::task::993::Storage.TaskManager.Task::(_decref) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::ref 0 aborting False >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,577::task::1200::Storage.TaskManager.Task::(commit) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::committing task: 94b41d4f-e515-49b8-9284-c5994008483e >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::moving from state queued -> state running >Thread-25::DEBUG::2014-08-12 15:24:07,579::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:07,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,580::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,580::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,580::__init__::225::IOProcess::(_processLogs) (14667) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,580::__init__::225::IOProcess::(_processLogs) (14667) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,580::__init__::225::IOProcess::(_processLogs) (14667) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,581::__init__::225::IOProcess::(_processLogs) (14667) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,581::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,581::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,581::task::752::Storage.TaskManager.Task::(_save) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e.temp >Thread-25::DEBUG::2014-08-12 15:24:07,582::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,582::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,582::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,582::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,583::__init__::225::IOProcess::(_processLogs) (14668) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,583::__init__::225::IOProcess::(_processLogs) (14668) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,583::__init__::225::IOProcess::(_processLogs) (14668) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,583::__init__::225::IOProcess::(_processLogs) (14668) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,583::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,584::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,585::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,585::__init__::225::IOProcess::(_processLogs) (14669) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,585::__init__::225::IOProcess::(_processLogs) (14669) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,585::__init__::225::IOProcess::(_processLogs) (14669) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,585::__init__::225::IOProcess::(_processLogs) (14669) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,585::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,586::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,586::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:07,586::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,587::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,587::__init__::225::IOProcess::(_processLogs) (14670) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,587::__init__::225::IOProcess::(_processLogs) (14670) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,587::__init__::225::IOProcess::(_processLogs) (14670) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,587::__init__::225::IOProcess::(_processLogs) (14670) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,588::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,589::__init__::225::IOProcess::(_processLogs) Message size is 647 >Thread-25::DEBUG::2014-08-12 15:24:07,589::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,589::__init__::225::IOProcess::(_processLogs) (14671) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,590::__init__::225::IOProcess::(_processLogs) (14671) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,590::__init__::225::IOProcess::(_processLogs) (14671) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,590::__init__::225::IOProcess::(_processLogs) (14671) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,590::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,591::__init__::225::IOProcess::(_processLogs) Message size is 420 >Thread-25::DEBUG::2014-08-12 15:24:07,591::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,592::__init__::225::IOProcess::(_processLogs) (14672) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,592::__init__::225::IOProcess::(_processLogs) (14672) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,592::__init__::225::IOProcess::(_processLogs) (14672) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,592::__init__::225::IOProcess::(_processLogs) (14672) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,592::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,593::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,593::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,594::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,594::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,594::__init__::225::IOProcess::(_processLogs) (14673) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,594::__init__::225::IOProcess::(_processLogs) (14673) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,594::__init__::225::IOProcess::(_processLogs) (14673) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,594::__init__::225::IOProcess::(_processLogs) (14673) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,595::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,595::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >94b41d4f-e515-49b8-9284-c5994008483e::WARNING::2014-08-12 15:24:07,595::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,596::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:07,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,597::__init__::225::IOProcess::(_processLogs) (14674) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,597::__init__::225::IOProcess::(_processLogs) (14674) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,597::__init__::225::IOProcess::(_processLogs) (14674) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,598::__init__::225::IOProcess::(_processLogs) (14674) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,598::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >94b41d4f-e515-49b8-9284-c5994008483e::WARNING::2014-08-12 15:24:07,598::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,599::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:07,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,599::__init__::225::IOProcess::(_processLogs) (14675) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,600::__init__::225::IOProcess::(_processLogs) (14675) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,600::__init__::225::IOProcess::(_processLogs) (14675) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,600::__init__::225::IOProcess::(_processLogs) (14675) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,600::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,601::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,602::__init__::225::IOProcess::(_processLogs) (14676) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,602::__init__::225::IOProcess::(_processLogs) (14676) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,602::__init__::225::IOProcess::(_processLogs) (14676) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,602::__init__::225::IOProcess::(_processLogs) (14676) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,603::__init__::225::IOProcess::(_processLogs) Sending response sized 174 >Thread-25::DEBUG::2014-08-12 15:24:07,603::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-25::DEBUG::2014-08-12 15:24:07,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,604::__init__::225::IOProcess::(_processLogs) (14677) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,604::__init__::225::IOProcess::(_processLogs) (14677) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,604::__init__::225::IOProcess::(_processLogs) (14677) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,604::__init__::225::IOProcess::(_processLogs) (14677) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,605::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,606::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-25::DEBUG::2014-08-12 15:24:07,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,606::__init__::225::IOProcess::(_processLogs) (14678) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,607::__init__::225::IOProcess::(_processLogs) (14678) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,607::__init__::225::IOProcess::(_processLogs) (14678) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,607::__init__::225::IOProcess::(_processLogs) (14678) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,607::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,608::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-25::DEBUG::2014-08-12 15:24:07,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,609::__init__::225::IOProcess::(_processLogs) (14679) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,609::__init__::225::IOProcess::(_processLogs) (14679) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,609::__init__::225::IOProcess::(_processLogs) (14679) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,609::__init__::225::IOProcess::(_processLogs) (14679) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,609::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,609::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,611::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-25::DEBUG::2014-08-12 15:24:07,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,611::__init__::225::IOProcess::(_processLogs) (14680) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,612::__init__::225::IOProcess::(_processLogs) (14680) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,612::__init__::225::IOProcess::(_processLogs) (14680) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,612::__init__::225::IOProcess::(_processLogs) (14680) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,612::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,613::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:07,613::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,614::__init__::225::IOProcess::(_processLogs) (14681) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,614::__init__::225::IOProcess::(_processLogs) (14681) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:07,614::__init__::225::IOProcess::(_processLogs) (14681) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,614::__init__::225::IOProcess::(_processLogs) (14681) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,614::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,615::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:07,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,616::__init__::225::IOProcess::(_processLogs) (14682) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:07,616::__init__::225::IOProcess::(_processLogs) (14682) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:07,616::__init__::225::IOProcess::(_processLogs) (14682) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,617::__init__::225::IOProcess::(_processLogs) (14682) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,617::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,617::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,617::task::905::Storage.TaskManager.Task::(_runJobs) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::Task.run: running job 0: deleteImage_9c06af0f-2451-41f1-a031-d08c4950266d: <function <lambda> at 0x7f31bc374398> (args: () kwargs: {}) >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,618::task::331::Storage.TaskManager.Task::(run) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::Job.run: running deleteImage_9c06af0f-2451-41f1-a031-d08c4950266d: <function <lambda> at 0x7f31bc374398> (args: () kwargs: {}) callback None >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::moving from state running -> state finished >Thread-25::DEBUG::2014-08-12 15:24:07,618::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-25::DEBUG::2014-08-12 15:24:07,618::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,619::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,619::__init__::225::IOProcess::(_processLogs) (14683) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,619::__init__::225::IOProcess::(_processLogs) (14683) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,619::__init__::225::IOProcess::(_processLogs) (14683) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,619::__init__::225::IOProcess::(_processLogs) (14683) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,620::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,620::task::752::Storage.TaskManager.Task::(_save) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::_save: orig /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e temp /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/master/tasks/94b41d4f-e515-49b8-9284-c5994008483e.temp >Thread-25::DEBUG::2014-08-12 15:24:07,621::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,621::__init__::225::IOProcess::(_processLogs) (14684) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,622::__init__::225::IOProcess::(_processLogs) (14684) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,622::__init__::225::IOProcess::(_processLogs) (14684) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,622::__init__::225::IOProcess::(_processLogs) (14684) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,622::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,623::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-25::DEBUG::2014-08-12 15:24:07,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,624::__init__::225::IOProcess::(_processLogs) (14685) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:07,624::__init__::225::IOProcess::(_processLogs) (14685) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:07,624::__init__::225::IOProcess::(_processLogs) (14685) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,624::__init__::225::IOProcess::(_processLogs) (14685) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,625::__init__::225::IOProcess::(_processLogs) Sending response sized 94 >Thread-25::DEBUG::2014-08-12 15:24:07,625::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-25::DEBUG::2014-08-12 15:24:07,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,626::__init__::225::IOProcess::(_processLogs) (14686) Finding callback 'mkdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,626::__init__::225::IOProcess::(_processLogs) (14686) Got request for method 'mkdir' >Thread-25::DEBUG::2014-08-12 15:24:07,626::__init__::225::IOProcess::(_processLogs) (14686) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,626::__init__::225::IOProcess::(_processLogs) (14686) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,627::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,627::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,628::__init__::225::IOProcess::(_processLogs) Message size is 651 >Thread-25::DEBUG::2014-08-12 15:24:07,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,628::__init__::225::IOProcess::(_processLogs) (14687) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,629::__init__::225::IOProcess::(_processLogs) (14687) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,629::__init__::225::IOProcess::(_processLogs) (14687) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,629::__init__::225::IOProcess::(_processLogs) (14687) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,629::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,630::__init__::225::IOProcess::(_processLogs) Message size is 337 >Thread-25::DEBUG::2014-08-12 15:24:07,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,631::__init__::225::IOProcess::(_processLogs) (14688) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,631::__init__::225::IOProcess::(_processLogs) (14688) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,631::__init__::225::IOProcess::(_processLogs) (14688) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,631::__init__::225::IOProcess::(_processLogs) (14688) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,631::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,631::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,632::__init__::225::IOProcess::(_processLogs) Message size is 420 >Thread-25::DEBUG::2014-08-12 15:24:07,632::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,632::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,633::__init__::225::IOProcess::(_processLogs) (14689) Finding callback 'writefile'... >Thread-25::DEBUG::2014-08-12 15:24:07,633::__init__::225::IOProcess::(_processLogs) (14689) Got request for method 'writefile' >Thread-25::DEBUG::2014-08-12 15:24:07,633::__init__::225::IOProcess::(_processLogs) (14689) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,633::__init__::225::IOProcess::(_processLogs) (14689) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,634::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-25::DEBUG::2014-08-12 15:24:07,634::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,634::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,635::__init__::225::IOProcess::(_processLogs) (14690) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,635::__init__::225::IOProcess::(_processLogs) (14690) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,635::__init__::225::IOProcess::(_processLogs) (14690) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,635::__init__::225::IOProcess::(_processLogs) (14690) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,636::__init__::225::IOProcess::(_processLogs) Sending response sized 95 >94b41d4f-e515-49b8-9284-c5994008483e::WARNING::2014-08-12 15:24:07,636::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,637::__init__::225::IOProcess::(_processLogs) Message size is 310 >Thread-25::DEBUG::2014-08-12 15:24:07,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,637::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,637::__init__::225::IOProcess::(_processLogs) (14691) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,638::__init__::225::IOProcess::(_processLogs) (14691) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,638::__init__::225::IOProcess::(_processLogs) (14691) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,638::__init__::225::IOProcess::(_processLogs) (14691) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,638::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,638::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >94b41d4f-e515-49b8-9284-c5994008483e::WARNING::2014-08-12 15:24:07,638::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-25::DEBUG::2014-08-12 15:24:07,639::__init__::225::IOProcess::(_processLogs) Message size is 308 >Thread-25::DEBUG::2014-08-12 15:24:07,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,640::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,640::__init__::225::IOProcess::(_processLogs) (14692) Finding callback 'rename'... >Thread-25::DEBUG::2014-08-12 15:24:07,640::__init__::225::IOProcess::(_processLogs) (14692) Got request for method 'rename' >Thread-25::DEBUG::2014-08-12 15:24:07,640::__init__::225::IOProcess::(_processLogs) (14692) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,640::__init__::225::IOProcess::(_processLogs) (14692) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,641::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,641::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-25::DEBUG::2014-08-12 15:24:07,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-14::DEBUG::2014-08-12 15:24:07,643::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-25::DEBUG::2014-08-12 15:24:07,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-14::DEBUG::2014-08-12 15:24:07,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`05e5a8ff-0504-4ea6-94c0-3f796b2cade7`::moving from state init -> state preparing >Thread-25::DEBUG::2014-08-12 15:24:07,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-14::INFO::2014-08-12 15:24:07,647::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-25::DEBUG::2014-08-12 15:24:07,648::__init__::225::IOProcess::(_processLogs) (14693) Finding callback 'listdir'... >Thread-14::DEBUG::2014-08-12 15:24:07,649::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-08-12 15:24:07,649::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: d9ae1b9a-2276-409c-99ef-2f0bb655b81d >Thread-25::DEBUG::2014-08-12 15:24:07,649::__init__::225::IOProcess::(_processLogs) (14693) Got request for method 'listdir' >Thread-14::DEBUG::2014-08-12 15:24:07,650::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd9ae1b9a-2276-409c-99ef-2f0bb655b81d'} >Thread-25::DEBUG::2014-08-12 15:24:07,651::__init__::225::IOProcess::(_processLogs) (14693) Building response >Thread-14::DEBUG::2014-08-12 15:24:07,651::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94b41d4f-e515-49b8-9284-c5994008483e >Thread-25::DEBUG::2014-08-12 15:24:07,652::__init__::225::IOProcess::(_processLogs) (14693) Queuing response >Thread-14::DEBUG::2014-08-12 15:24:07,652::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94b41d4f-e515-49b8-9284-c5994008483e'} >Thread-14::DEBUG::2014-08-12 15:24:07,653::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'d9ae1b9a-2276-409c-99ef-2f0bb655b81d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd9ae1b9a-2276-409c-99ef-2f0bb655b81d'}, '94b41d4f-e515-49b8-9284-c5994008483e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94b41d4f-e515-49b8-9284-c5994008483e'}} >Thread-25::DEBUG::2014-08-12 15:24:07,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-14::INFO::2014-08-12 15:24:07,654::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'d9ae1b9a-2276-409c-99ef-2f0bb655b81d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd9ae1b9a-2276-409c-99ef-2f0bb655b81d'}, '94b41d4f-e515-49b8-9284-c5994008483e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94b41d4f-e515-49b8-9284-c5994008483e'}}} >Thread-25::DEBUG::2014-08-12 15:24:07,655::__init__::225::IOProcess::(_processLogs) Sending response sized 174 >Thread-14::DEBUG::2014-08-12 15:24:07,655::task::1191::Storage.TaskManager.Task::(prepare) Task=`05e5a8ff-0504-4ea6-94c0-3f796b2cade7`::finished: {'allTasksStatus': {'d9ae1b9a-2276-409c-99ef-2f0bb655b81d': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd9ae1b9a-2276-409c-99ef-2f0bb655b81d'}, '94b41d4f-e515-49b8-9284-c5994008483e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94b41d4f-e515-49b8-9284-c5994008483e'}}} >Thread-14::DEBUG::2014-08-12 15:24:07,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`05e5a8ff-0504-4ea6-94c0-3f796b2cade7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:07,657::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:07,658::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:07,659::task::993::Storage.TaskManager.Task::(_decref) Task=`05e5a8ff-0504-4ea6-94c0-3f796b2cade7`::ref 0 aborting False >Thread-25::DEBUG::2014-08-12 15:24:07,660::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-25::DEBUG::2014-08-12 15:24:07,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,662::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,663::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,664::__init__::225::IOProcess::(_processLogs) (14694) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,664::__init__::225::IOProcess::(_processLogs) (14694) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,664::__init__::225::IOProcess::(_processLogs) (14694) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,664::__init__::225::IOProcess::(_processLogs) (14694) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,664::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,665::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-25::DEBUG::2014-08-12 15:24:07,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,666::__init__::225::IOProcess::(_processLogs) (14695) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,666::__init__::225::IOProcess::(_processLogs) (14695) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,667::__init__::225::IOProcess::(_processLogs) (14695) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,667::__init__::225::IOProcess::(_processLogs) (14695) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,667::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,668::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-25::DEBUG::2014-08-12 15:24:07,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,668::__init__::225::IOProcess::(_processLogs) (14696) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,669::__init__::225::IOProcess::(_processLogs) (14696) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,669::__init__::225::IOProcess::(_processLogs) (14696) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,669::__init__::225::IOProcess::(_processLogs) (14696) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,669::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,670::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-25::DEBUG::2014-08-12 15:24:07,670::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,670::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,671::__init__::225::IOProcess::(_processLogs) (14697) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,671::__init__::225::IOProcess::(_processLogs) (14697) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,671::__init__::225::IOProcess::(_processLogs) (14697) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,671::__init__::225::IOProcess::(_processLogs) (14697) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,672::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,672::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,672::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-25::DEBUG::2014-08-12 15:24:07,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,673::__init__::225::IOProcess::(_processLogs) (14698) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,673::__init__::225::IOProcess::(_processLogs) (14698) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:07,673::__init__::225::IOProcess::(_processLogs) (14698) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,674::__init__::225::IOProcess::(_processLogs) (14698) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,674::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,674::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,674::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:07,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,675::__init__::225::IOProcess::(_processLogs) (14699) Finding callback 'lexists'... >Thread-25::DEBUG::2014-08-12 15:24:07,675::__init__::225::IOProcess::(_processLogs) (14699) Got request for method 'lexists' >Thread-25::DEBUG::2014-08-12 15:24:07,676::__init__::225::IOProcess::(_processLogs) (14699) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,676::__init__::225::IOProcess::(_processLogs) (14699) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,676::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>, 'Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>} >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,677::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,677::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,677::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,677::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,677::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,678::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf' >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,678::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,678::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,678::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.9c06af0f-2451-41f1-a031-d08c4950266d_180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,678::task::916::Storage.TaskManager.Task::(_runJobs) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::Task.run: exit - success: result True >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,678::task::993::Storage.TaskManager.Task::(_decref) Task=`94b41d4f-e515-49b8-9284-c5994008483e`::ref 0 aborting False >94b41d4f-e515-49b8-9284-c5994008483e::DEBUG::2014-08-12 15:24:07,679::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-14::DEBUG::2014-08-12 15:24:07,734::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:24:07,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc1b2b98-f51c-42fe-8408-1fe2fb3dd183`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:07,734::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='d9ae1b9a-2276-409c-99ef-2f0bb655b81d', spUUID=None, options=None) >Thread-14::DEBUG::2014-08-12 15:24:07,735::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: d9ae1b9a-2276-409c-99ef-2f0bb655b81d >Thread-25::DEBUG::2014-08-12 15:24:07,735::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:07,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:07,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,737::__init__::225::IOProcess::(_processLogs) (14700) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,737::__init__::225::IOProcess::(_processLogs) (14700) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:07,737::__init__::225::IOProcess::(_processLogs) (14700) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,738::__init__::225::IOProcess::(_processLogs) (14700) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,738::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,738::__init__::225::IOProcess::(_processLogs) Sending response sized 225 >Thread-25::DEBUG::2014-08-12 15:24:07,739::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-25::DEBUG::2014-08-12 15:24:07,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,739::__init__::225::IOProcess::(_processLogs) (14701) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,740::__init__::225::IOProcess::(_processLogs) (14701) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,740::__init__::225::IOProcess::(_processLogs) (14701) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,740::__init__::225::IOProcess::(_processLogs) (14701) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,740::__init__::225::IOProcess::(_processLogs) Sending response sized 320 >Thread-25::DEBUG::2014-08-12 15:24:07,741::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-25::DEBUG::2014-08-12 15:24:07,741::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,742::__init__::225::IOProcess::(_processLogs) (14702) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,742::__init__::225::IOProcess::(_processLogs) (14702) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,742::__init__::225::IOProcess::(_processLogs) (14702) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,742::__init__::225::IOProcess::(_processLogs) (14702) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,743::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-25::DEBUG::2014-08-12 15:24:07,743::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,744::__init__::225::IOProcess::(_processLogs) (14703) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,744::__init__::225::IOProcess::(_processLogs) (14703) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,744::__init__::225::IOProcess::(_processLogs) (14703) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,744::__init__::225::IOProcess::(_processLogs) (14703) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,745::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,745::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,746::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-25::DEBUG::2014-08-12 15:24:07,746::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,746::__init__::225::IOProcess::(_processLogs) (14704) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,747::__init__::225::IOProcess::(_processLogs) (14704) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,747::__init__::225::IOProcess::(_processLogs) (14704) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,747::__init__::225::IOProcess::(_processLogs) (14704) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,747::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,748::__init__::225::IOProcess::(_processLogs) Message size is 212 >Thread-25::DEBUG::2014-08-12 15:24:07,748::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,749::__init__::225::IOProcess::(_processLogs) (14705) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:07,749::__init__::225::IOProcess::(_processLogs) (14705) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:07,749::__init__::225::IOProcess::(_processLogs) (14705) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,749::__init__::225::IOProcess::(_processLogs) (14705) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,749::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:07,750::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-25::DEBUG::2014-08-12 15:24:07,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,751::__init__::225::IOProcess::(_processLogs) (14706) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:07,751::__init__::225::IOProcess::(_processLogs) (14706) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:07,751::__init__::225::IOProcess::(_processLogs) (14706) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,751::__init__::225::IOProcess::(_processLogs) (14706) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,752::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:07,752::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-25::DEBUG::2014-08-12 15:24:07,753::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:07,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:07,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:07,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:07,753::__init__::225::IOProcess::(_processLogs) (14707) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:07,753::__init__::225::IOProcess::(_processLogs) (14707) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:07,754::__init__::225::IOProcess::(_processLogs) (14707) Building response >Thread-25::DEBUG::2014-08-12 15:24:07,754::__init__::225::IOProcess::(_processLogs) (14707) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:07,754::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:07,754::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:24:07,754::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-14::INFO::2014-08-12 15:24:07,754::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-08-12 15:24:07,755::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc1b2b98-f51c-42fe-8408-1fe2fb3dd183`::finished: None >Thread-14::DEBUG::2014-08-12 15:24:07,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc1b2b98-f51c-42fe-8408-1fe2fb3dd183`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:07,755::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:07,755::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:07,755::task::993::Storage.TaskManager.Task::(_decref) Task=`fc1b2b98-f51c-42fe-8408-1fe2fb3dd183`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:24:08,527::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:24:08,527::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:08,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-33::DEBUG::2014-08-12 15:24:08,711::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:24:08,712::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:24:08,712::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:24:08,725::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000546031 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:08,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281195 s, 36.4 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:24:09,143::task::595::Storage.TaskManager.Task::(_updateState) Task=`42ab0bf0-8f4a-4e94-a2f5-09ac281bdda9`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:24:09,143::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:24:09,143::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:24:09,143::task::1191::Storage.TaskManager.Task::(prepare) Task=`42ab0bf0-8f4a-4e94-a2f5-09ac281bdda9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:24:09,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`42ab0bf0-8f4a-4e94-a2f5-09ac281bdda9`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:24:09,144::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:24:09,144::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:24:09,144::task::993::Storage.TaskManager.Task::(_decref) Task=`42ab0bf0-8f4a-4e94-a2f5-09ac281bdda9`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:24:09,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f1c8b06-3b8b-4071-b16d-6f0a2cd56326`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:24:09,145::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:24:09,145::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:24:09,145::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f1c8b06-3b8b-4071-b16d-6f0a2cd56326`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:24:09,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f1c8b06-3b8b-4071-b16d-6f0a2cd56326`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:24:09,145::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:24:09,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:24:09,146::task::993::Storage.TaskManager.Task::(_decref) Task=`7f1c8b06-3b8b-4071-b16d-6f0a2cd56326`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:24:09,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:24:09,206::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068348 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:24:09,210::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:24:09,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:09,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:09,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:09,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:09,211::__init__::225::IOProcess::(_processLogs) (14708) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:09,211::__init__::225::IOProcess::(_processLogs) (14708) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:09,211::__init__::225::IOProcess::(_processLogs) (14708) Building response >Thread-25::DEBUG::2014-08-12 15:24:09,211::__init__::225::IOProcess::(_processLogs) (14708) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:09,212::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:09,212::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:09,213::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:24:09,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:09,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:09,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:09,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:09,214::__init__::225::IOProcess::(_processLogs) (14709) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:09,214::__init__::225::IOProcess::(_processLogs) (14709) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:09,214::__init__::225::IOProcess::(_processLogs) (14709) Building response >Thread-25::DEBUG::2014-08-12 15:24:09,214::__init__::225::IOProcess::(_processLogs) (14709) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:09,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:09,214::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:24:09,259::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:24:09,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`c51d8ff9-ccaf-4a9f-8977-b349d2ffd25c`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:09,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:24:09,292::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:09,292::task::1191::Storage.TaskManager.Task::(prepare) Task=`c51d8ff9-ccaf-4a9f-8977-b349d2ffd25c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:09,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`c51d8ff9-ccaf-4a9f-8977-b349d2ffd25c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:09,292::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:09,292::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:09,293::task::993::Storage.TaskManager.Task::(_decref) Task=`c51d8ff9-ccaf-4a9f-8977-b349d2ffd25c`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:24:09,312::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:24:09,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4fce1e1-f453-4757-968a-9d0dbd13dba0`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:24:09,313::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:24:09,313::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`eef4fce5-0470-4169-9271-e23f63a4171f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:24:09,313::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:24:09,314::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:09,314::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`eef4fce5-0470-4169-9271-e23f63a4171f`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:09,314::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c4fce1e1-f453-4757-968a-9d0dbd13dba0`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:24:09,314::task::993::Storage.TaskManager.Task::(_decref) Task=`c4fce1e1-f453-4757-968a-9d0dbd13dba0`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:24:09,327::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:09,327::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4fce1e1-f453-4757-968a-9d0dbd13dba0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:09,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4fce1e1-f453-4757-968a-9d0dbd13dba0`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:24:09,327::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:24:09,328::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:24:09,328::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:24:09,328::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:24:09,328::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:24:09,328::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:24:09,329::task::993::Storage.TaskManager.Task::(_decref) Task=`c4fce1e1-f453-4757-968a-9d0dbd13dba0`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:10,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:10,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:10,077::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:10,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:10,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121322 s, 84.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:12,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:12,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155928 s, 65.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:14,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:14,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131955 s, 77.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:15,079::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:15,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:15,081::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:17,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:17,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013049 s, 78.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:24:17,693::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5a88410a] >Thread-14::DEBUG::2014-08-12 15:24:17,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c43655c-330f-4f4e-bd5b-7ec9f20c3f74`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:17,701::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-08-12 15:24:17,701::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-08-12 15:24:17,702::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94b41d4f-e515-49b8-9284-c5994008483e >Thread-14::DEBUG::2014-08-12 15:24:17,702::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94b41d4f-e515-49b8-9284-c5994008483e'} >Thread-14::DEBUG::2014-08-12 15:24:17,702::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94b41d4f-e515-49b8-9284-c5994008483e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94b41d4f-e515-49b8-9284-c5994008483e'}} >Thread-14::INFO::2014-08-12 15:24:17,702::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94b41d4f-e515-49b8-9284-c5994008483e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94b41d4f-e515-49b8-9284-c5994008483e'}}} >Thread-14::DEBUG::2014-08-12 15:24:17,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c43655c-330f-4f4e-bd5b-7ec9f20c3f74`::finished: {'allTasksStatus': {'94b41d4f-e515-49b8-9284-c5994008483e': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94b41d4f-e515-49b8-9284-c5994008483e'}}} >Thread-14::DEBUG::2014-08-12 15:24:17,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c43655c-330f-4f4e-bd5b-7ec9f20c3f74`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:17,703::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:17,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:17,703::task::993::Storage.TaskManager.Task::(_decref) Task=`9c43655c-330f-4f4e-bd5b-7ec9f20c3f74`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:24:17,739::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5a88410a] >Thread-14::DEBUG::2014-08-12 15:24:17,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0a78647-e66f-4090-b3e2-1351b4de2d0e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:17,740::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='94b41d4f-e515-49b8-9284-c5994008483e', spUUID=None, options=None) >Thread-14::DEBUG::2014-08-12 15:24:17,740::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: 94b41d4f-e515-49b8-9284-c5994008483e >Thread-25::DEBUG::2014-08-12 15:24:17,741::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-25::DEBUG::2014-08-12 15:24:17,741::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:17,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:17,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:17,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:17,741::__init__::225::IOProcess::(_processLogs) (14710) Finding callback 'listdir'... >Thread-25::DEBUG::2014-08-12 15:24:17,742::__init__::225::IOProcess::(_processLogs) (14710) Got request for method 'listdir' >Thread-25::DEBUG::2014-08-12 15:24:17,742::__init__::225::IOProcess::(_processLogs) (14710) Building response >Thread-25::DEBUG::2014-08-12 15:24:17,742::__init__::225::IOProcess::(_processLogs) (14710) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:17,742::__init__::225::IOProcess::(_processLogs) Sending response sized 225 >Thread-25::DEBUG::2014-08-12 15:24:17,743::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-25::DEBUG::2014-08-12 15:24:17,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:17,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:17,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:17,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:17,744::__init__::225::IOProcess::(_processLogs) (14711) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:17,744::__init__::225::IOProcess::(_processLogs) (14711) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:17,744::__init__::225::IOProcess::(_processLogs) (14711) Building response >Thread-25::DEBUG::2014-08-12 15:24:17,744::__init__::225::IOProcess::(_processLogs) (14711) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:17,745::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:17,745::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:17,746::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-25::DEBUG::2014-08-12 15:24:17,746::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:17,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:17,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:17,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:17,747::__init__::225::IOProcess::(_processLogs) (14712) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:17,747::__init__::225::IOProcess::(_processLogs) (14712) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:17,747::__init__::225::IOProcess::(_processLogs) (14712) Building response >Thread-25::DEBUG::2014-08-12 15:24:17,747::__init__::225::IOProcess::(_processLogs) (14712) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:17,747::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:17,747::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:17,748::__init__::225::IOProcess::(_processLogs) Message size is 212 >Thread-25::DEBUG::2014-08-12 15:24:17,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:17,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:17,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:17,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:17,749::__init__::225::IOProcess::(_processLogs) (14713) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:17,749::__init__::225::IOProcess::(_processLogs) (14713) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:17,749::__init__::225::IOProcess::(_processLogs) (14713) Building response >Thread-25::DEBUG::2014-08-12 15:24:17,749::__init__::225::IOProcess::(_processLogs) (14713) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:17,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:17,750::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-25::DEBUG::2014-08-12 15:24:17,751::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-25::DEBUG::2014-08-12 15:24:17,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:17,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:17,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:17,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:17,752::__init__::225::IOProcess::(_processLogs) (14714) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:17,752::__init__::225::IOProcess::(_processLogs) (14714) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:17,752::__init__::225::IOProcess::(_processLogs) (14714) Building response >Thread-25::DEBUG::2014-08-12 15:24:17,752::__init__::225::IOProcess::(_processLogs) (14714) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:17,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:17,752::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:17,753::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-25::DEBUG::2014-08-12 15:24:17,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:17,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:17,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:17,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:17,754::__init__::225::IOProcess::(_processLogs) (14715) Finding callback 'stat'... >Thread-25::DEBUG::2014-08-12 15:24:17,754::__init__::225::IOProcess::(_processLogs) (14715) Got request for method 'stat' >Thread-25::DEBUG::2014-08-12 15:24:17,754::__init__::225::IOProcess::(_processLogs) (14715) Building response >Thread-25::DEBUG::2014-08-12 15:24:17,754::__init__::225::IOProcess::(_processLogs) (14715) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:17,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:17,755::__init__::225::IOProcess::(_processLogs) Sending response sized 320 >Thread-25::DEBUG::2014-08-12 15:24:17,756::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-25::DEBUG::2014-08-12 15:24:17,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:17,756::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:17,756::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:17,756::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:17,756::__init__::225::IOProcess::(_processLogs) (14716) Finding callback 'unlink'... >Thread-25::DEBUG::2014-08-12 15:24:17,757::__init__::225::IOProcess::(_processLogs) (14716) Got request for method 'unlink' >Thread-25::DEBUG::2014-08-12 15:24:17,757::__init__::225::IOProcess::(_processLogs) (14716) Building response >Thread-25::DEBUG::2014-08-12 15:24:17,757::__init__::225::IOProcess::(_processLogs) (14716) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:17,757::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:17,757::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:17,758::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-25::DEBUG::2014-08-12 15:24:17,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:17,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:17,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:17,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:17,759::__init__::225::IOProcess::(_processLogs) (14717) Finding callback 'rmdir'... >Thread-25::DEBUG::2014-08-12 15:24:17,759::__init__::225::IOProcess::(_processLogs) (14717) Got request for method 'rmdir' >Thread-25::DEBUG::2014-08-12 15:24:17,759::__init__::225::IOProcess::(_processLogs) (14717) Building response >Thread-25::DEBUG::2014-08-12 15:24:17,759::__init__::225::IOProcess::(_processLogs) (14717) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:17,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:17,759::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:24:17,760::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-14::INFO::2014-08-12 15:24:17,760::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-08-12 15:24:17,760::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0a78647-e66f-4090-b3e2-1351b4de2d0e`::finished: None >Thread-14::DEBUG::2014-08-12 15:24:17,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0a78647-e66f-4090-b3e2-1351b4de2d0e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:17,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:17,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:17,761::task::993::Storage.TaskManager.Task::(_decref) Task=`d0a78647-e66f-4090-b3e2-1351b4de2d0e`::ref 0 aborting False >Thread-33::DEBUG::2014-08-12 15:24:18,728::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:24:18,743::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663039 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:19,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:19,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133467 s, 76.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:24:19,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe0ca033-3862-4127-9e9d-c2284f69764d`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:19,189::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:24:19,190::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068348', 'lastCheck': '10.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663039', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:24:19,190::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe0ca033-3862-4127-9e9d-c2284f69764d`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068348', 'lastCheck': '10.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663039', 'lastCheck': '0.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:24:19,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe0ca033-3862-4127-9e9d-c2284f69764d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:19,190::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:19,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:19,191::task::993::Storage.TaskManager.Task::(_decref) Task=`fe0ca033-3862-4127-9e9d-c2284f69764d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:24:19,216::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:24:19,229::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714591 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:24:19,233::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:24:19,233::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:19,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:19,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:19,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:19,234::__init__::225::IOProcess::(_processLogs) (14718) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:19,234::__init__::225::IOProcess::(_processLogs) (14718) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:19,234::__init__::225::IOProcess::(_processLogs) (14718) Building response >Thread-25::DEBUG::2014-08-12 15:24:19,234::__init__::225::IOProcess::(_processLogs) (14718) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:19,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:19,235::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:19,235::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:24:19,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:19,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:19,236::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:19,236::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:19,236::__init__::225::IOProcess::(_processLogs) (14719) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:19,237::__init__::225::IOProcess::(_processLogs) (14719) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:19,237::__init__::225::IOProcess::(_processLogs) (14719) Building response >Thread-25::DEBUG::2014-08-12 15:24:19,237::__init__::225::IOProcess::(_processLogs) (14719) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:19,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:19,237::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:24:19,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:24:19,347::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:24:19,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d861ec0-c2f6-4b62-b535-d3a622137b76`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:19,348::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:24:19,384::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:19,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d861ec0-c2f6-4b62-b535-d3a622137b76`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:19,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d861ec0-c2f6-4b62-b535-d3a622137b76`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:19,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:19,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:19,385::task::993::Storage.TaskManager.Task::(_decref) Task=`4d861ec0-c2f6-4b62-b535-d3a622137b76`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:24:19,485::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:24:19,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`86a34629-a92d-4e95-92c1-f8696178dbdb`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:24:19,486::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:24:19,486::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`4d9ded1f-659e-4237-892d-43a49875a97d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:24:19,486::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:24:19,487::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:19,487::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`4d9ded1f-659e-4237-892d-43a49875a97d`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:19,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`86a34629-a92d-4e95-92c1-f8696178dbdb`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:24:19,487::task::993::Storage.TaskManager.Task::(_decref) Task=`86a34629-a92d-4e95-92c1-f8696178dbdb`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:24:19,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:19,500::task::1191::Storage.TaskManager.Task::(prepare) Task=`86a34629-a92d-4e95-92c1-f8696178dbdb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:19,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`86a34629-a92d-4e95-92c1-f8696178dbdb`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:24:19,501::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:24:19,501::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:24:19,501::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:24:19,501::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:24:19,502::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:24:19,502::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:24:19,502::task::993::Storage.TaskManager.Task::(_decref) Task=`86a34629-a92d-4e95-92c1-f8696178dbdb`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:20,087::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:20,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:20,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:21,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:21,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131986 s, 77.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:23,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:23,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131823 s, 77.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:25,095::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:25,096::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:25,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:24:25,287::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:24:25,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:25,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148575 s, 68.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:27,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:27,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130101 s, 78.7 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:24:28,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:24:28,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000786057 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:24:29,239::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:24:29,250::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684585 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:24:29,253::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:24:29,253::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:29,253::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:24:29,254::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:29,254::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:29,254::__init__::225::IOProcess::(_processLogs) (14720) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:29,254::__init__::225::IOProcess::(_processLogs) (14720) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:29,254::__init__::225::IOProcess::(_processLogs) (14720) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:29,254::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:29,255::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:29,255::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:24:29,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:29,256::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:29,256::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:29,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:29,256::__init__::225::IOProcess::(_processLogs) (14721) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:29,256::__init__::225::IOProcess::(_processLogs) (14721) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:29,257::__init__::225::IOProcess::(_processLogs) (14721) Building response >Thread-25::DEBUG::2014-08-12 15:24:29,257::__init__::225::IOProcess::(_processLogs) (14721) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:29,257::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:29,257::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:24:29,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:29,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125127 s, 81.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:24:29,518::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:24:29,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e0f454d-c26e-499d-8eaa-4ed3a14038a3`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:29,520::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:24:29,532::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:29,532::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e0f454d-c26e-499d-8eaa-4ed3a14038a3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:29,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e0f454d-c26e-499d-8eaa-4ed3a14038a3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:29,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:29,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:29,533::task::993::Storage.TaskManager.Task::(_decref) Task=`6e0f454d-c26e-499d-8eaa-4ed3a14038a3`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:24:29,544::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:24:29,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c3e3beb-c9cf-4e8e-a6d5-887d0b966208`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:24:29,544::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:24:29,545::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c3e3a255-c046-4f44-bf85-84a1b001971e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:24:29,545::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:24:29,545::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:29,545::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c3e3a255-c046-4f44-bf85-84a1b001971e`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:29,546::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4c3e3beb-c9cf-4e8e-a6d5-887d0b966208`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:24:29,546::task::993::Storage.TaskManager.Task::(_decref) Task=`4c3e3beb-c9cf-4e8e-a6d5-887d0b966208`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:24:29,574::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:29,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c3e3beb-c9cf-4e8e-a6d5-887d0b966208`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:29,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c3e3beb-c9cf-4e8e-a6d5-887d0b966208`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:24:29,575::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:24:29,575::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:24:29,575::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:24:29,576::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:24:29,576::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:24:29,576::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:24:29,576::task::993::Storage.TaskManager.Task::(_decref) Task=`4c3e3beb-c9cf-4e8e-a6d5-887d0b966208`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:30,117::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:30,118::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:30,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:31,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:31,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121168 s, 84.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:33,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:33,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120866 s, 84.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:24:34,409::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6fe5236-b932-4f28-92a7-65631803fcdb`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:34,409::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:24:34,409::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684585', 'lastCheck': '5.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000786057', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:24:34,409::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6fe5236-b932-4f28-92a7-65631803fcdb`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684585', 'lastCheck': '5.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000786057', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:24:34,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6fe5236-b932-4f28-92a7-65631803fcdb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:34,410::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:34,410::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:34,410::task::993::Storage.TaskManager.Task::(_decref) Task=`f6fe5236-b932-4f28-92a7-65631803fcdb`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:24:34,432::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:35,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:35,130::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:35,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:35,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:35,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120832 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:37,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:37,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148708 s, 68.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:24:38,758::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:24:38,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729014 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:24:39,258::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::DEBUG::2014-08-12 15:24:39,259::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:24:39,259::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:24:39,271::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000601562 s, 3.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:24:39,271::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000601562 s, 3.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:24:39,271::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:24:39,271::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:24:39,272::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:24:39,272::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:24:39,272::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:24:39,273::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:24:39,273::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:24:39,273::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:24:39,273::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:24:39,566::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:24:39,567::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:24:39,567::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::INFO::2014-08-12 15:24:39,568::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::INFO::2014-08-12 15:24:39,568::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::INFO::2014-08-12 15:24:39,569::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:24:39,569::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-14::DEBUG::2014-08-12 15:24:39,591::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:24:39,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a0d3e4a-8b13-4cb5-ade7-56f08c31d394`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:39,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:24:39,626::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:39,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a0d3e4a-8b13-4cb5-ade7-56f08c31d394`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:39,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a0d3e4a-8b13-4cb5-ade7-56f08c31d394`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:39,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:39,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:39,627::task::993::Storage.TaskManager.Task::(_decref) Task=`5a0d3e4a-8b13-4cb5-ade7-56f08c31d394`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:24:39,639::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:24:39,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`59280646-1488-4ab0-b48e-0b834b686660`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:24:39,639::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:24:39,640::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`81904262-2cbc-46c8-b565-ac12f3b7b014`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:24:39,640::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:24:39,640::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:39,641::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`81904262-2cbc-46c8-b565-ac12f3b7b014`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:39,641::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`59280646-1488-4ab0-b48e-0b834b686660`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:24:39,641::task::993::Storage.TaskManager.Task::(_decref) Task=`59280646-1488-4ab0-b48e-0b834b686660`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:24:39,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:39,654::task::1191::Storage.TaskManager.Task::(prepare) Task=`59280646-1488-4ab0-b48e-0b834b686660`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:39,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`59280646-1488-4ab0-b48e-0b834b686660`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:24:39,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:24:39,654::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:24:39,654::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:24:39,655::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:24:39,655::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:24:39,655::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:24:39,655::task::993::Storage.TaskManager.Task::(_decref) Task=`59280646-1488-4ab0-b48e-0b834b686660`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:24:39,740::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:24:39,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:24:39,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637155 s, 6.4 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:24:39,757::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:24:39,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:39,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:39,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:39,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:39,758::__init__::225::IOProcess::(_processLogs) (14722) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:39,759::__init__::225::IOProcess::(_processLogs) (14722) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:39,759::__init__::225::IOProcess::(_processLogs) (14722) Building response >Thread-25::DEBUG::2014-08-12 15:24:39,759::__init__::225::IOProcess::(_processLogs) (14722) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:39,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:39,759::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:39,760::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:24:39,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:39,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:39,760::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:39,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:39,761::__init__::225::IOProcess::(_processLogs) (14723) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:39,761::__init__::225::IOProcess::(_processLogs) (14723) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:39,761::__init__::225::IOProcess::(_processLogs) (14723) Building response >Thread-25::DEBUG::2014-08-12 15:24:39,761::__init__::225::IOProcess::(_processLogs) (14723) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:39,761::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:39,762::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:24:39,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:39,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130379 s, 78.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:40,151::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:40,153::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:40,163::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:41,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:41,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014182 s, 72.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:43,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:44,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121198 s, 84.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:45,165::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:45,167::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:45,175::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:46,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:46,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205225 s, 49.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:48,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:48,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120536 s, 85.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:24:48,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:24:48,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696395 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:24:49,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ecb6a4c-5070-473f-ac98-279ae723d5c8`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:49,535::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:24:49,535::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637155', 'lastCheck': '9.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696395', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:24:49,535::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ecb6a4c-5070-473f-ac98-279ae723d5c8`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637155', 'lastCheck': '9.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696395', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:24:49,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ecb6a4c-5070-473f-ac98-279ae723d5c8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:49,536::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:49,536::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:49,536::task::993::Storage.TaskManager.Task::(_decref) Task=`4ecb6a4c-5070-473f-ac98-279ae723d5c8`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:24:49,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:24:49,670::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:24:49,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6c7503a-8883-4c6a-9396-7a094bceba58`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:49,671::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:24:49,702::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:49,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6c7503a-8883-4c6a-9396-7a094bceba58`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:49,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6c7503a-8883-4c6a-9396-7a094bceba58`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:49,702::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:49,702::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:49,702::task::993::Storage.TaskManager.Task::(_decref) Task=`a6c7503a-8883-4c6a-9396-7a094bceba58`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:24:49,715::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:24:49,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a8b8c17-42c4-4137-9ef0-a610e3585b9e`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:24:49,715::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:24:49,716::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`66bd66b4-450c-4583-9880-796165e14144`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:24:49,716::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:24:49,716::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:49,717::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`66bd66b4-450c-4583-9880-796165e14144`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:49,717::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0a8b8c17-42c4-4137-9ef0-a610e3585b9e`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:24:49,717::task::993::Storage.TaskManager.Task::(_decref) Task=`0a8b8c17-42c4-4137-9ef0-a610e3585b9e`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:24:49,729::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:49,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a8b8c17-42c4-4137-9ef0-a610e3585b9e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:49,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a8b8c17-42c4-4137-9ef0-a610e3585b9e`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:24:49,730::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:24:49,730::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:24:49,730::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:24:49,730::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:24:49,731::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:24:49,731::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:24:49,731::task::993::Storage.TaskManager.Task::(_decref) Task=`0a8b8c17-42c4-4137-9ef0-a610e3585b9e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:24:49,763::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:24:49,774::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528341 s, 7.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:24:49,778::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:24:49,778::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:49,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:49,778::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:49,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:49,778::__init__::225::IOProcess::(_processLogs) (14724) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:49,779::__init__::225::IOProcess::(_processLogs) (14724) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:49,779::__init__::225::IOProcess::(_processLogs) (14724) Building response >Thread-25::DEBUG::2014-08-12 15:24:49,779::__init__::225::IOProcess::(_processLogs) (14724) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:49,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:49,779::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:49,780::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:24:49,780::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:49,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:49,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:49,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:49,781::__init__::225::IOProcess::(_processLogs) (14725) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:49,781::__init__::225::IOProcess::(_processLogs) (14725) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:49,781::__init__::225::IOProcess::(_processLogs) (14725) Building response >Thread-25::DEBUG::2014-08-12 15:24:49,782::__init__::225::IOProcess::(_processLogs) (14725) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:49,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:49,782::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:50,180::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:50,181::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:50,187::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:24:50,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:50,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122855 s, 83.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:52,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:52,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128281 s, 79.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:54,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:54,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122133 s, 83.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:55,194::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:55,195::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:24:55,211::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:24:55,350::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:24:56,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:56,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121792 s, 84.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:24:58,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:24:58,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120968 s, 84.7 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:24:58,785::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:24:58,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693776 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:24:59,760::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [3010def3] >Thread-14::DEBUG::2014-08-12 15:24:59,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`b34a2bf2-3127-4923-a6b4-ed22f3057274`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:24:59,761::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-16::DEBUG::2014-08-12 15:24:59,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-14::INFO::2014-08-12 15:24:59,795::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:24:59,796::task::1191::Storage.TaskManager.Task::(prepare) Task=`b34a2bf2-3127-4923-a6b4-ed22f3057274`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-16::DEBUG::2014-08-12 15:24:59,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704113 s, 5.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:24:59,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`b34a2bf2-3127-4923-a6b4-ed22f3057274`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:24:59,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:24:59,799::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:24:59,800::task::993::Storage.TaskManager.Task::(_decref) Task=`b34a2bf2-3127-4923-a6b4-ed22f3057274`::ref 0 aborting False >Thread-25::DEBUG::2014-08-12 15:24:59,805::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:24:59,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:59,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:59,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:59,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:59,806::__init__::225::IOProcess::(_processLogs) (14726) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:59,807::__init__::225::IOProcess::(_processLogs) (14726) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:59,807::__init__::225::IOProcess::(_processLogs) (14726) Building response >Thread-25::DEBUG::2014-08-12 15:24:59,807::__init__::225::IOProcess::(_processLogs) (14726) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:59,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:59,807::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:24:59,808::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:24:59,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:24:59,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:24:59,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:24:59,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:24:59,809::__init__::225::IOProcess::(_processLogs) (14727) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:24:59,809::__init__::225::IOProcess::(_processLogs) (14727) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:24:59,809::__init__::225::IOProcess::(_processLogs) (14727) Building response >Thread-25::DEBUG::2014-08-12 15:24:59,809::__init__::225::IOProcess::(_processLogs) (14727) Queuing response >Thread-25::DEBUG::2014-08-12 15:24:59,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:24:59,810::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-32::DEBUG::2014-08-12 15:24:59,829::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [3010def3] >Thread-32::DEBUG::2014-08-12 15:24:59,830::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c932db8-d90f-46e9-b7d8-86d8f27422c3`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:24:59,830::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:24:59,831::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`12c35acf-ff13-4f73-badf-b17b84fb3288`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:24:59,831::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:24:59,831::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:24:59,831::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`12c35acf-ff13-4f73-badf-b17b84fb3288`::Granted request >Thread-32::DEBUG::2014-08-12 15:24:59,832::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9c932db8-d90f-46e9-b7d8-86d8f27422c3`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:24:59,832::task::993::Storage.TaskManager.Task::(_decref) Task=`9c932db8-d90f-46e9-b7d8-86d8f27422c3`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:24:59,844::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:59,844::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c932db8-d90f-46e9-b7d8-86d8f27422c3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:24:59,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c932db8-d90f-46e9-b7d8-86d8f27422c3`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:24:59,845::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:24:59,845::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:24:59,845::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:24:59,845::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:24:59,846::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:24:59,846::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:24:59,846::task::993::Storage.TaskManager.Task::(_decref) Task=`9c932db8-d90f-46e9-b7d8-86d8f27422c3`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:00,217::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:00,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:00,228::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:00,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:00,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012077 s, 84.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:02,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:02,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129911 s, 78.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:25:04,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f87293b-712b-4895-8a39-730149ef629b`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:04,663::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:25:04,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704113', 'lastCheck': '4.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693776', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:25:04,663::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f87293b-712b-4895-8a39-730149ef629b`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704113', 'lastCheck': '4.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693776', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:25:04,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f87293b-712b-4895-8a39-730149ef629b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:04,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:04,664::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:04,664::task::993::Storage.TaskManager.Task::(_decref) Task=`7f87293b-712b-4895-8a39-730149ef629b`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:25:04,689::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:04,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:04,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130259 s, 78.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:05,235::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:05,237::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:05,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:06,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:06,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130956 s, 78.2 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:08,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:08,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000772499 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:08,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:09,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130643 s, 78.4 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-08-12 15:25:09,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c94f3b9-b9f4-4013-b89a-bad414d7878d`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:25:09,581::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:25:09,582::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:25:09,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c94f3b9-b9f4-4013-b89a-bad414d7878d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:25:09,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c94f3b9-b9f4-4013-b89a-bad414d7878d`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:25:09,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:25:09,583::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:25:09,583::task::993::Storage.TaskManager.Task::(_decref) Task=`8c94f3b9-b9f4-4013-b89a-bad414d7878d`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:25:09,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`b804d970-3536-41f0-9f53-b1053d1acfab`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:25:09,583::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:25:09,584::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:25:09,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`b804d970-3536-41f0-9f53-b1053d1acfab`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:25:09,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`b804d970-3536-41f0-9f53-b1053d1acfab`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:25:09,584::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:25:09,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:25:09,584::task::993::Storage.TaskManager.Task::(_decref) Task=`b804d970-3536-41f0-9f53-b1053d1acfab`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:25:09,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:25:09,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720552 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:25:09,825::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:25:09,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:09,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:09,826::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:09,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:09,826::__init__::225::IOProcess::(_processLogs) (14728) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:09,826::__init__::225::IOProcess::(_processLogs) (14728) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:09,827::__init__::225::IOProcess::(_processLogs) (14728) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:09,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:09,827::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:25:09,828::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:25:09,828::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:09,828::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:25:09,828::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:09,829::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:09,829::__init__::225::IOProcess::(_processLogs) (14729) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:09,829::__init__::225::IOProcess::(_processLogs) (14729) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:09,829::__init__::225::IOProcess::(_processLogs) (14729) Building response >Thread-25::DEBUG::2014-08-12 15:25:09,829::__init__::225::IOProcess::(_processLogs) (14729) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:09,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:09,830::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:25:09,944::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:25:09,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4af0635-942b-45fa-8e82-ff19d4b7c9b2`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:09,945::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:25:09,968::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:09,968::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4af0635-942b-45fa-8e82-ff19d4b7c9b2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:09,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4af0635-942b-45fa-8e82-ff19d4b7c9b2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:09,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:09,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:09,969::task::993::Storage.TaskManager.Task::(_decref) Task=`f4af0635-942b-45fa-8e82-ff19d4b7c9b2`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:25:09,988::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:25:09,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`197be400-2d03-44a1-b8eb-bbde0180e2ec`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:25:09,988::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:25:09,989::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a2437911-9064-4fe7-ab74-1ee22fd9f89e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:25:09,989::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:25:09,989::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:25:09,990::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a2437911-9064-4fe7-ab74-1ee22fd9f89e`::Granted request >Thread-32::DEBUG::2014-08-12 15:25:09,990::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`197be400-2d03-44a1-b8eb-bbde0180e2ec`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:25:09,990::task::993::Storage.TaskManager.Task::(_decref) Task=`197be400-2d03-44a1-b8eb-bbde0180e2ec`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:25:10,002::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:10,003::task::1191::Storage.TaskManager.Task::(prepare) Task=`197be400-2d03-44a1-b8eb-bbde0180e2ec`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:10,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`197be400-2d03-44a1-b8eb-bbde0180e2ec`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:25:10,004::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:25:10,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:25:10,004::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:25:10,004::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:25:10,004::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:25:10,005::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:25:10,005::task::993::Storage.TaskManager.Task::(_decref) Task=`197be400-2d03-44a1-b8eb-bbde0180e2ec`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:10,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:10,266::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:10,277::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:11,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:11,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013036 s, 78.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:13,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:13,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128631 s, 79.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:15,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:15,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126079 s, 81.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:15,284::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:15,285::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:15,295::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:17,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:17,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121728 s, 84.1 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:18,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:18,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707398 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:19,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:19,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123046 s, 83.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:25:19,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`13fa9ed0-12a9-486c-970c-56faa25e11fe`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:19,790::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:25:19,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720552', 'lastCheck': '10.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707398', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:25:19,790::task::1191::Storage.TaskManager.Task::(prepare) Task=`13fa9ed0-12a9-486c-970c-56faa25e11fe`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720552', 'lastCheck': '10.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707398', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:25:19,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`13fa9ed0-12a9-486c-970c-56faa25e11fe`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:19,791::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:19,791::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:19,791::task::993::Storage.TaskManager.Task::(_decref) Task=`13fa9ed0-12a9-486c-970c-56faa25e11fe`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:25:19,816::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-16::DEBUG::2014-08-12 15:25:19,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:25:19,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070475 s, 5.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:25:19,846::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:25:19,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:19,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:19,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:19,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:19,847::__init__::225::IOProcess::(_processLogs) (14730) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:19,847::__init__::225::IOProcess::(_processLogs) (14730) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:19,847::__init__::225::IOProcess::(_processLogs) (14730) Building response >Thread-25::DEBUG::2014-08-12 15:25:19,847::__init__::225::IOProcess::(_processLogs) (14730) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:19,847::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:25:19,848::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:25:19,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:19,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:19,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:19,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:19,849::__init__::225::IOProcess::(_processLogs) (14731) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:19,849::__init__::225::IOProcess::(_processLogs) (14731) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:19,849::__init__::225::IOProcess::(_processLogs) (14731) Building response >Thread-25::DEBUG::2014-08-12 15:25:19,850::__init__::225::IOProcess::(_processLogs) (14731) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:19,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:19,850::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:25:20,022::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:25:20,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`2aefdcab-58a6-4453-92c0-0b951735029f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:20,023::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:25:20,061::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:20,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`2aefdcab-58a6-4453-92c0-0b951735029f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:20,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`2aefdcab-58a6-4453-92c0-0b951735029f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:20,062::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:20,062::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:20,062::task::993::Storage.TaskManager.Task::(_decref) Task=`2aefdcab-58a6-4453-92c0-0b951735029f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:25:20,073::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:25:20,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f1831df-782f-4e41-b8a4-924b9a8cc0b3`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:25:20,074::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:25:20,074::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`95961e5a-bdb6-41b5-bf40-55272648d8d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:25:20,074::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:25:20,075::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:25:20,075::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`95961e5a-bdb6-41b5-bf40-55272648d8d6`::Granted request >Thread-32::DEBUG::2014-08-12 15:25:20,075::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6f1831df-782f-4e41-b8a4-924b9a8cc0b3`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:25:20,075::task::993::Storage.TaskManager.Task::(_decref) Task=`6f1831df-782f-4e41-b8a4-924b9a8cc0b3`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:25:20,088::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:20,088::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f1831df-782f-4e41-b8a4-924b9a8cc0b3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:20,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f1831df-782f-4e41-b8a4-924b9a8cc0b3`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:25:20,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:25:20,089::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:25:20,089::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:25:20,089::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:25:20,089::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:25:20,089::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:25:20,090::task::993::Storage.TaskManager.Task::(_decref) Task=`6f1831df-782f-4e41-b8a4-924b9a8cc0b3`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:20,301::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:20,302::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:20,306::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:21,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:21,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0167911 s, 61.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:23,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:23,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0199066 s, 51.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:25,313::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:25,313::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:25,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-12 15:25:25,387::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >Dummy-31::DEBUG::2014-08-12 15:25:25,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:25,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127213 s, 80.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:27,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:27,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124849 s, 82.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:28,824::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-33::DEBUG::2014-08-12 15:25:28,825::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:25:28,825::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:28,837::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000719014 s, 2.8 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:28,837::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000719014 s, 2.8 MB/s'], size: 2048 >Thread-33::DEBUG::2014-08-12 15:25:28,837::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-33::DEBUG::2014-08-12 15:25:28,837::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-33::DEBUG::2014-08-12 15:25:28,838::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-33::DEBUG::2014-08-12 15:25:28,838::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:25:28,838::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:25:28,838::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:25:28,839::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:25:28,839::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-33::DEBUG::2014-08-12 15:25:28,839::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:29,091::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:29,091::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-33::DEBUG::2014-08-12 15:25:29,092::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-33::INFO::2014-08-12 15:25:29,093::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-33::INFO::2014-08-12 15:25:29,093::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-33::INFO::2014-08-12 15:25:29,093::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-33::DEBUG::2014-08-12 15:25:29,093::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:29,266::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:29,267::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:29,278::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540794 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:29,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:29,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121826 s, 84.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:25:29,851::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:25:29,864::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070864 s, 5.8 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:25:29,867::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:25:29,874::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:29,874::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:25:29,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:29,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:29,875::__init__::225::IOProcess::(_processLogs) (14732) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:29,875::__init__::225::IOProcess::(_processLogs) (14732) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:29,875::__init__::225::IOProcess::(_processLogs) (14732) Building response >Thread-25::DEBUG::2014-08-12 15:25:29,875::__init__::225::IOProcess::(_processLogs) (14732) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:29,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:29,875::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:25:29,876::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:25:29,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:25:29,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:29,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:29,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:29,877::__init__::225::IOProcess::(_processLogs) (14733) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:29,877::__init__::225::IOProcess::(_processLogs) (14733) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:29,877::__init__::225::IOProcess::(_processLogs) (14733) Building response >Thread-25::DEBUG::2014-08-12 15:25:29,878::__init__::225::IOProcess::(_processLogs) (14733) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:29,878::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:25:30,106::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [515eee7c] >Thread-14::DEBUG::2014-08-12 15:25:30,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`3328461c-755f-421c-861c-624ef4096aef`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:30,107::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:25:30,119::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:30,120::task::1191::Storage.TaskManager.Task::(prepare) Task=`3328461c-755f-421c-861c-624ef4096aef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:30,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`3328461c-755f-421c-861c-624ef4096aef`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:30,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:30,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:30,120::task::993::Storage.TaskManager.Task::(_decref) Task=`3328461c-755f-421c-861c-624ef4096aef`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:25:30,135::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [515eee7c] >Thread-32::DEBUG::2014-08-12 15:25:30,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`9588ad8c-8f87-4ec2-9db6-ab6e1a6d6470`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:25:30,136::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:25:30,136::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c62a77d6-976a-477a-8d2a-89edb2418520`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:25:30,136::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:25:30,137::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:25:30,137::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`c62a77d6-976a-477a-8d2a-89edb2418520`::Granted request >Thread-32::DEBUG::2014-08-12 15:25:30,137::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9588ad8c-8f87-4ec2-9db6-ab6e1a6d6470`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:25:30,137::task::993::Storage.TaskManager.Task::(_decref) Task=`9588ad8c-8f87-4ec2-9db6-ab6e1a6d6470`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:25:30,150::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:30,150::task::1191::Storage.TaskManager.Task::(prepare) Task=`9588ad8c-8f87-4ec2-9db6-ab6e1a6d6470`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:30,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`9588ad8c-8f87-4ec2-9db6-ab6e1a6d6470`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:25:30,151::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:25:30,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:25:30,151::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:25:30,151::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:25:30,151::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:25:30,152::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:25:30,152::task::993::Storage.TaskManager.Task::(_decref) Task=`9588ad8c-8f87-4ec2-9db6-ab6e1a6d6470`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:30,342::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:30,343::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:30,354::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:31,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:31,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122042 s, 83.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:33,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:33,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120224 s, 85.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:25:34,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`72552439-1d12-468b-967c-1735a1fcaedd`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:34,927::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:25:34,927::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070864', 'lastCheck': '5.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540794', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:25:34,927::task::1191::Storage.TaskManager.Task::(prepare) Task=`72552439-1d12-468b-967c-1735a1fcaedd`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070864', 'lastCheck': '5.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540794', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:25:34,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`72552439-1d12-468b-967c-1735a1fcaedd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:34,928::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:34,928::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:34,928::task::993::Storage.TaskManager.Task::(_decref) Task=`72552439-1d12-468b-967c-1735a1fcaedd`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:25:34,950::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:35,360::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:35,361::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:35,377::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:35,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:35,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119783 s, 85.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:37,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:38,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132454 s, 77.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:39,281::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:39,292::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700474 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:25:39,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:25:39,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732809 s, 5.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:25:39,894::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:25:39,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:39,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:25:39,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:39,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:39,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:39,895::__init__::225::IOProcess::(_processLogs) (14734) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:39,895::__init__::225::IOProcess::(_processLogs) (14734) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:39,896::__init__::225::IOProcess::(_processLogs) (14734) Building response >Thread-25::DEBUG::2014-08-12 15:25:39,896::__init__::225::IOProcess::(_processLogs) (14734) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:39,896::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:39,896::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:25:39,899::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:25:39,899::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:25:39,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:39,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:39,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:39,900::__init__::225::IOProcess::(_processLogs) (14735) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:39,900::__init__::225::IOProcess::(_processLogs) (14735) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:39,900::__init__::225::IOProcess::(_processLogs) (14735) Building response >Thread-25::DEBUG::2014-08-12 15:25:39,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:39,900::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:25:40,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:40,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012195 s, 84.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:25:40,173::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:25:40,174::task::595::Storage.TaskManager.Task::(_updateState) Task=`84774a29-f667-4b67-9672-28ea0649135e`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:40,174::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:25:40,212::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:40,212::task::1191::Storage.TaskManager.Task::(prepare) Task=`84774a29-f667-4b67-9672-28ea0649135e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:40,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`84774a29-f667-4b67-9672-28ea0649135e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:40,212::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:40,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:40,213::task::993::Storage.TaskManager.Task::(_decref) Task=`84774a29-f667-4b67-9672-28ea0649135e`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:25:40,231::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:25:40,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3ecba08-bc21-4e7c-b5af-60f361fec3f3`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:25:40,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:25:40,232::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`43c1e0c8-857e-46e4-b74e-23a74e5aeedc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:25:40,232::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:25:40,233::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:25:40,233::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`43c1e0c8-857e-46e4-b74e-23a74e5aeedc`::Granted request >Thread-32::DEBUG::2014-08-12 15:25:40,233::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c3ecba08-bc21-4e7c-b5af-60f361fec3f3`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:25:40,233::task::993::Storage.TaskManager.Task::(_decref) Task=`c3ecba08-bc21-4e7c-b5af-60f361fec3f3`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:25:40,246::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:40,246::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3ecba08-bc21-4e7c-b5af-60f361fec3f3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:40,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3ecba08-bc21-4e7c-b5af-60f361fec3f3`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:25:40,247::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:25:40,247::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:25:40,247::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:25:40,247::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:25:40,248::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:25:40,248::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:25:40,248::task::993::Storage.TaskManager.Task::(_decref) Task=`c3ecba08-bc21-4e7c-b5af-60f361fec3f3`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:40,384::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:40,384::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:40,401::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:42,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:42,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123467 s, 82.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:44,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:44,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120525 s, 85.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:45,407::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:45,408::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:45,418::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:46,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:46,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0216393 s, 47.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:48,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:48,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121151 s, 84.5 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:49,294::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:49,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694102 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:25:49,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:25:49,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716589 s, 5.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:25:49,916::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:25:49,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:49,917::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:25:49,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:49,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:49,917::__init__::225::IOProcess::(_processLogs) (14736) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:49,917::__init__::225::IOProcess::(_processLogs) (14736) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:49,918::__init__::225::IOProcess::(_processLogs) (14736) Building response >Thread-25::DEBUG::2014-08-12 15:25:49,918::__init__::225::IOProcess::(_processLogs) (14736) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:49,918::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:49,918::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:25:49,919::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:25:49,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:49,919::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:49,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:49,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:49,920::__init__::225::IOProcess::(_processLogs) (14737) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:49,920::__init__::225::IOProcess::(_processLogs) (14737) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:49,920::__init__::225::IOProcess::(_processLogs) (14737) Building response >Thread-25::DEBUG::2014-08-12 15:25:49,920::__init__::225::IOProcess::(_processLogs) (14737) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:49,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:49,920::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:25:50,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`89a43939-a7e7-4279-bcaa-5831223737b5`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:50,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:25:50,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716589', 'lastCheck': '0.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694102', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:25:50,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`89a43939-a7e7-4279-bcaa-5831223737b5`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716589', 'lastCheck': '0.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694102', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:25:50,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`89a43939-a7e7-4279-bcaa-5831223737b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:50,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:50,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:50,078::task::993::Storage.TaskManager.Task::(_decref) Task=`89a43939-a7e7-4279-bcaa-5831223737b5`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:25:50,100::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:25:50,264::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:25:50,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ee9f78c-c82e-4b6b-8024-8e4606fc2cf1`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:25:50,264::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:25:50,276::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:50,277::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ee9f78c-c82e-4b6b-8024-8e4606fc2cf1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:25:50,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ee9f78c-c82e-4b6b-8024-8e4606fc2cf1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:25:50,277::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:25:50,277::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:25:50,277::task::993::Storage.TaskManager.Task::(_decref) Task=`5ee9f78c-c82e-4b6b-8024-8e4606fc2cf1`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:25:50,288::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:25:50,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3b7b035-7ddd-4264-9f02-40cd25abef29`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:25:50,289::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:25:50,289::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2cb83de7-c47a-4f1b-9de5-bf6c1408afe6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:25:50,290::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:25:50,290::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:25:50,290::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`2cb83de7-c47a-4f1b-9de5-bf6c1408afe6`::Granted request >Thread-32::DEBUG::2014-08-12 15:25:50,290::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b3b7b035-7ddd-4264-9f02-40cd25abef29`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:25:50,291::task::993::Storage.TaskManager.Task::(_decref) Task=`b3b7b035-7ddd-4264-9f02-40cd25abef29`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:25:50,303::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:50,303::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3b7b035-7ddd-4264-9f02-40cd25abef29`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:25:50,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3b7b035-7ddd-4264-9f02-40cd25abef29`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:25:50,303::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:25:50,304::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:25:50,304::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:25:50,304::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:25:50,305::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:25:50,305::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:25:50,307::task::993::Storage.TaskManager.Task::(_decref) Task=`b3b7b035-7ddd-4264-9f02-40cd25abef29`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:50,424::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:50,425::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:50,430::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:50,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:50,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126199 s, 81.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:52,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:52,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124052 s, 82.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:54,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:54,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122144 s, 83.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:25:55,422::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:55,436::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:55,437::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:25:55,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:25:56,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:56,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119888 s, 85.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:25:58,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:25:58,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0145594 s, 70.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:25:59,307::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:25:59,318::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581574 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:25:59,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:25:59,935::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631811 s, 6.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:25:59,938::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:25:59,939::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:59,939::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:25:59,939::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:59,939::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:59,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:59,940::__init__::225::IOProcess::(_processLogs) (14738) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:59,940::__init__::225::IOProcess::(_processLogs) (14738) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:59,940::__init__::225::IOProcess::(_processLogs) (14738) Building response >Thread-25::DEBUG::2014-08-12 15:25:59,940::__init__::225::IOProcess::(_processLogs) (14738) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:59,940::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:59,940::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:25:59,941::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:25:59,941::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:25:59,941::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:25:59,942::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:25:59,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:25:59,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:25:59,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:25:59,942::__init__::225::IOProcess::(_processLogs) (14739) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:25:59,942::__init__::225::IOProcess::(_processLogs) (14739) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:25:59,943::__init__::225::IOProcess::(_processLogs) (14739) Building response >Thread-25::DEBUG::2014-08-12 15:25:59,943::__init__::225::IOProcess::(_processLogs) (14739) Queuing response >Thread-25::DEBUG::2014-08-12 15:25:59,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:25:59,943::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:26:00,329::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:26:00,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`822ada84-4483-4062-ac37-48a0718f6d66`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:00,329::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:26:00,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:00,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`822ada84-4483-4062-ac37-48a0718f6d66`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:00,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`822ada84-4483-4062-ac37-48a0718f6d66`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:00,365::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:00,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:00,368::task::993::Storage.TaskManager.Task::(_decref) Task=`822ada84-4483-4062-ac37-48a0718f6d66`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:26:00,390::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:26:00,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f445e10-c891-46d4-8863-4439574ac9d3`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:26:00,391::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:26:00,391::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`0c3736d9-e6a5-4060-8302-f7cea53a0aa4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:26:00,391::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:26:00,391::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:26:00,392::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`0c3736d9-e6a5-4060-8302-f7cea53a0aa4`::Granted request >Thread-32::DEBUG::2014-08-12 15:26:00,392::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3f445e10-c891-46d4-8863-4439574ac9d3`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:26:00,392::task::993::Storage.TaskManager.Task::(_decref) Task=`3f445e10-c891-46d4-8863-4439574ac9d3`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:26:00,405::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:00,405::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f445e10-c891-46d4-8863-4439574ac9d3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:00,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f445e10-c891-46d4-8863-4439574ac9d3`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:26:00,405::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:26:00,405::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:26:00,406::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:26:00,406::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:26:00,406::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:26:00,406::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:26:00,407::task::993::Storage.TaskManager.Task::(_decref) Task=`3f445e10-c891-46d4-8863-4439574ac9d3`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:00,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:00,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:00,471::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:00,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:00,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123123 s, 83.2 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:02,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:03,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127342 s, 80.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:05,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:05,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121319 s, 84.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:26:05,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`71123b09-dff9-42a1-a3f7-b78fd16e2483`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:05,198::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:26:05,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631811', 'lastCheck': '5.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581574', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:26:05,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`71123b09-dff9-42a1-a3f7-b78fd16e2483`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631811', 'lastCheck': '5.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581574', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:26:05,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`71123b09-dff9-42a1-a3f7-b78fd16e2483`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:05,199::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:05,199::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:05,199::task::993::Storage.TaskManager.Task::(_decref) Task=`71123b09-dff9-42a1-a3f7-b78fd16e2483`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:26:05,222::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:05,477::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:05,478::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:05,495::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:07,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:07,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131872 s, 77.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:09,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:09,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124264 s, 82.4 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:26:09,320::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:26:09,332::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674915 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:26:09,945::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:26:09,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614127 s, 6.7 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:26:09,959::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:26:09,960::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:26:09,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:09,960::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Queuing request... >Thread-25::DEBUG::2014-08-12 15:26:09,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:09,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:09,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:09,961::__init__::225::IOProcess::(_processLogs) (14740) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:09,961::__init__::225::IOProcess::(_processLogs) (14740) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:09,961::__init__::225::IOProcess::(_processLogs) (14740) Building response >Thread-25::DEBUG::2014-08-12 15:26:09,961::__init__::225::IOProcess::(_processLogs) (14740) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:09,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:09,961::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:26:09,962::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:26:09,962::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:26:09,963::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:09,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:26:09,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:09,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:09,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:09,963::__init__::225::IOProcess::(_processLogs) (14741) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:09,964::__init__::225::IOProcess::(_processLogs) (14741) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:09,964::__init__::225::IOProcess::(_processLogs) (14741) Building response >Thread-25::DEBUG::2014-08-12 15:26:09,964::__init__::225::IOProcess::(_processLogs) (14741) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:09,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:09,964::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-44::DEBUG::2014-08-12 15:26:09,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`9521bfd6-f833-4076-ae76-443dba2ddd51`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:26:09,980::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:26:09,980::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:26:09,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`9521bfd6-f833-4076-ae76-443dba2ddd51`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:26:09,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`9521bfd6-f833-4076-ae76-443dba2ddd51`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:26:09,981::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:26:09,981::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:26:09,981::task::993::Storage.TaskManager.Task::(_decref) Task=`9521bfd6-f833-4076-ae76-443dba2ddd51`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:26:09,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d824223-bdd7-492b-9f44-7472dd79321a`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:26:09,981::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:26:09,982::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:26:09,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d824223-bdd7-492b-9f44-7472dd79321a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:26:09,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d824223-bdd7-492b-9f44-7472dd79321a`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:26:09,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:26:09,982::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:26:09,982::task::993::Storage.TaskManager.Task::(_decref) Task=`7d824223-bdd7-492b-9f44-7472dd79321a`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:26:10,430::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:26:10,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a6dbf5b-cb6d-4a3a-b809-87be8934f8eb`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:10,431::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:26:10,442::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:10,443::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a6dbf5b-cb6d-4a3a-b809-87be8934f8eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:10,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a6dbf5b-cb6d-4a3a-b809-87be8934f8eb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:10,443::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:10,443::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:10,443::task::993::Storage.TaskManager.Task::(_decref) Task=`1a6dbf5b-cb6d-4a3a-b809-87be8934f8eb`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:26:10,454::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:26:10,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5c84752-40c6-439a-a403-e33207d48ad0`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:26:10,454::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:26:10,455::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`836744c1-0429-4291-91dd-fefc5ae58d4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:26:10,455::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:26:10,455::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:26:10,456::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`836744c1-0429-4291-91dd-fefc5ae58d4c`::Granted request >Thread-32::DEBUG::2014-08-12 15:26:10,456::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b5c84752-40c6-439a-a403-e33207d48ad0`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:26:10,456::task::993::Storage.TaskManager.Task::(_decref) Task=`b5c84752-40c6-439a-a403-e33207d48ad0`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:26:10,468::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:10,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5c84752-40c6-439a-a403-e33207d48ad0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:10,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5c84752-40c6-439a-a403-e33207d48ad0`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:26:10,469::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:26:10,469::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:26:10,469::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:26:10,470::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:26:10,470::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:26:10,470::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:26:10,470::task::993::Storage.TaskManager.Task::(_decref) Task=`b5c84752-40c6-439a-a403-e33207d48ad0`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:10,497::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:10,497::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:10,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:11,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:11,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122847 s, 83.4 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:13,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:13,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127601 s, 80.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:15,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:15,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130719 s, 78.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:15,513::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:15,514::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:15,524::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:17,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:17,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121484 s, 84.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:26:19,333::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:26:19,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620383 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:19,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:19,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119661 s, 85.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:26:19,966::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:26:19,977::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667285 s, 6.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:26:19,980::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:26:19,980::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:26:19,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:19,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:26:19,981::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:19,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:19,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:19,981::__init__::225::IOProcess::(_processLogs) (14742) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:19,982::__init__::225::IOProcess::(_processLogs) (14742) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:19,982::__init__::225::IOProcess::(_processLogs) (14742) Building response >Thread-25::DEBUG::2014-08-12 15:26:19,982::__init__::225::IOProcess::(_processLogs) (14742) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:19,982::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:19,982::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:26:19,983::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:26:19,983::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:26:19,983::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:19,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:26:19,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:19,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:19,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:19,984::__init__::225::IOProcess::(_processLogs) (14743) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:19,984::__init__::225::IOProcess::(_processLogs) (14743) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:19,984::__init__::225::IOProcess::(_processLogs) (14743) Building response >Thread-25::DEBUG::2014-08-12 15:26:19,985::__init__::225::IOProcess::(_processLogs) (14743) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:19,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:19,985::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:26:20,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b8340fa-22f7-48f1-b565-6b22eae97a0a`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:20,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:26:20,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667285', 'lastCheck': '0.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620383', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:26:20,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b8340fa-22f7-48f1-b565-6b22eae97a0a`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667285', 'lastCheck': '0.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620383', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:26:20,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b8340fa-22f7-48f1-b565-6b22eae97a0a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:20,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:20,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:20,348::task::993::Storage.TaskManager.Task::(_decref) Task=`6b8340fa-22f7-48f1-b565-6b22eae97a0a`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:26:20,376::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:26:20,489::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:26:20,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`80b63bde-10db-4823-a9c9-83e9e6a74622`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:20,489::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:26:20,517::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:20,517::task::1191::Storage.TaskManager.Task::(prepare) Task=`80b63bde-10db-4823-a9c9-83e9e6a74622`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:20,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`80b63bde-10db-4823-a9c9-83e9e6a74622`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:20,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:20,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:20,531::task::993::Storage.TaskManager.Task::(_decref) Task=`80b63bde-10db-4823-a9c9-83e9e6a74622`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:20,532::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:20,535::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:20,536::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-32::DEBUG::2014-08-12 15:26:20,561::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:26:20,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`d82eaadb-6869-4d39-b3f0-08cb1bab23a5`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:26:20,561::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:26:20,562::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`00c6cb2f-207e-458b-80ea-af4440ea70ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:26:20,562::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:26:20,562::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:26:20,563::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`00c6cb2f-207e-458b-80ea-af4440ea70ae`::Granted request >Thread-32::DEBUG::2014-08-12 15:26:20,563::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d82eaadb-6869-4d39-b3f0-08cb1bab23a5`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:26:20,563::task::993::Storage.TaskManager.Task::(_decref) Task=`d82eaadb-6869-4d39-b3f0-08cb1bab23a5`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:26:20,575::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:20,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`d82eaadb-6869-4d39-b3f0-08cb1bab23a5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:20,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`d82eaadb-6869-4d39-b3f0-08cb1bab23a5`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:26:20,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:26:20,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:26:20,576::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:26:20,577::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:26:20,577::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:26:20,577::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:26:20,577::task::993::Storage.TaskManager.Task::(_decref) Task=`d82eaadb-6869-4d39-b3f0-08cb1bab23a5`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:26:21,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:21,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121513 s, 84.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:23,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:23,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119923 s, 85.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:26:25,467::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:25,542::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:25,543::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:25,553::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:25,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:25,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121177 s, 84.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:27,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:27,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118642 s, 86.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:26:29,346::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:26:29,358::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068263 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:29,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:29,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120922 s, 84.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:26:29,986::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:26:29,999::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666053 s, 6.1 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:26:30,002::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:26:30,002::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:26:30,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:30,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:26:30,003::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:30,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:30,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:30,004::__init__::225::IOProcess::(_processLogs) (14744) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:30,004::__init__::225::IOProcess::(_processLogs) (14744) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:30,004::__init__::225::IOProcess::(_processLogs) (14744) Building response >Thread-25::DEBUG::2014-08-12 15:26:30,004::__init__::225::IOProcess::(_processLogs) (14744) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:30,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:30,004::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:26:30,005::__init__::225::IOProcess::(_processLogs) (14738) Queuing responseDEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:26:30,005::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:26:30,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:30,006::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:26:30,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:30,006::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:30,006::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:30,006::__init__::225::IOProcess::(_processLogs) (14745) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:30,006::__init__::225::IOProcess::(_processLogs) (14745) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:30,007::__init__::225::IOProcess::(_processLogs) (14745) Building response >Thread-25::DEBUG::2014-08-12 15:26:30,007::__init__::225::IOProcess::(_processLogs) DEBUG|(14745) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:30,007::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:30,007::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:30,559::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:30,560::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:30,565::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:26:30,595::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:26:30,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`82d8e75a-a6a8-44a4-a290-a84a0dadd48f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:30,596::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:26:30,608::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:30,608::task::1191::Storage.TaskManager.Task::(prepare) Task=`82d8e75a-a6a8-44a4-a290-a84a0dadd48f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:30,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`82d8e75a-a6a8-44a4-a290-a84a0dadd48f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:30,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:30,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:30,608::task::993::Storage.TaskManager.Task::(_decref) Task=`82d8e75a-a6a8-44a4-a290-a84a0dadd48f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:26:30,620::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:26:30,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5ef2a64-ef23-48b0-bf68-385403a7486d`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:26:30,620::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:26:30,621::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`84fdef22-9513-4be3-81c6-750056c492c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:26:30,621::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:26:30,621::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:26:30,622::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`84fdef22-9513-4be3-81c6-750056c492c2`::Granted request >Thread-32::DEBUG::2014-08-12 15:26:30,624::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f5ef2a64-ef23-48b0-bf68-385403a7486d`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:26:30,624::task::993::Storage.TaskManager.Task::(_decref) Task=`f5ef2a64-ef23-48b0-bf68-385403a7486d`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:26:30,637::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:30,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5ef2a64-ef23-48b0-bf68-385403a7486d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:30,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5ef2a64-ef23-48b0-bf68-385403a7486d`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:26:30,637::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:26:30,637::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:26:30,638::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:26:30,638::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:26:30,638::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:26:30,638::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:26:30,638::task::993::Storage.TaskManager.Task::(_decref) Task=`f5ef2a64-ef23-48b0-bf68-385403a7486d`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:26:31,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:32,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278282 s, 36.8 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:34,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:34,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123718 s, 82.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:26:35,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`e775dc48-a9f3-472c-9c22-db43dced4a97`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:35,489::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:26:35,490::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666053', 'lastCheck': '5.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068263', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:26:35,490::task::1191::Storage.TaskManager.Task::(prepare) Task=`e775dc48-a9f3-472c-9c22-db43dced4a97`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666053', 'lastCheck': '5.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068263', 'lastCheck': '6.1', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:26:35,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`e775dc48-a9f3-472c-9c22-db43dced4a97`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:35,490::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:35,490::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:35,491::task::993::Storage.TaskManager.Task::(_decref) Task=`e775dc48-a9f3-472c-9c22-db43dced4a97`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:26:35,520::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:35,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:35,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:35,588::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:36,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:36,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122 s, 83.9 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:38,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:38,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123848 s, 82.7 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:26:39,359::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:26:39,371::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653105 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:26:40,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:26:40,020::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653679 s, 6.3 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:26:40,023::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-25::DEBUG::2014-08-12 15:26:40,024::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:26:40,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:40,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:26:40,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:40,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:40,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:40,025::__init__::225::IOProcess::(_processLogs) (14746) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:40,025::__init__::225::IOProcess::(_processLogs) (14746) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:40,025::__init__::225::IOProcess::(_processLogs) (14746) Building response >Thread-25::DEBUG::2014-08-12 15:26:40,025::__init__::225::IOProcess::(_processLogs) (14746) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:40,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:40,026::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:26:40,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:40,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:40,027::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:40,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:40,027::__init__::225::IOProcess::(_processLogs) (14747) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:40,027::__init__::225::IOProcess::(_processLogs) (14747) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:40,027::__init__::225::IOProcess::(_processLogs) (14747) Building response >Thread-25::DEBUG::2014-08-12 15:26:40,027::__init__::225::IOProcess::(_processLogs) (14747) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:40,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:40,028::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-31::DEBUG::2014-08-12 15:26:40,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:40,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0159593 s, 64.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:40,594::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:40,595::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:40,606::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:26:40,657::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:26:40,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`14d64014-9fa2-4e17-9aea-6cfe16bf53fc`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:40,658::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:26:40,670::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:40,670::task::1191::Storage.TaskManager.Task::(prepare) Task=`14d64014-9fa2-4e17-9aea-6cfe16bf53fc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:40,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`14d64014-9fa2-4e17-9aea-6cfe16bf53fc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:40,671::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:40,671::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:40,671::task::993::Storage.TaskManager.Task::(_decref) Task=`14d64014-9fa2-4e17-9aea-6cfe16bf53fc`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:26:40,843::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:26:40,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`26bbb43d-cee0-41e9-8f1a-023535d38c80`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:26:40,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:26:40,844::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`4ec44cab-7d57-4c74-8d72-ee79c6446a20`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:26:40,845::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:26:40,845::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:26:40,845::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`4ec44cab-7d57-4c74-8d72-ee79c6446a20`::Granted request >Thread-32::DEBUG::2014-08-12 15:26:40,845::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`26bbb43d-cee0-41e9-8f1a-023535d38c80`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:26:40,846::task::993::Storage.TaskManager.Task::(_decref) Task=`26bbb43d-cee0-41e9-8f1a-023535d38c80`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:26:40,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:40,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`26bbb43d-cee0-41e9-8f1a-023535d38c80`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:40,859::task::595::Storage.TaskManager.Task::(_updateState) Task=`26bbb43d-cee0-41e9-8f1a-023535d38c80`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:26:40,859::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:26:40,859::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:26:40,859::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:26:40,859::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:26:40,860::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:26:40,860::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:26:40,860::task::993::Storage.TaskManager.Task::(_decref) Task=`26bbb43d-cee0-41e9-8f1a-023535d38c80`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:26:42,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:42,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132555 s, 77.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:44,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:44,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195367 s, 52.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:45,612::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:45,613::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:45,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:46,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:46,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304124 s, 33.7 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:48,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:48,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128545 s, 79.7 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:26:49,373::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:26:49,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709469 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:26:50,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:26:50,041::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731345 s, 5.6 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:26:50,044::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:26:50,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:50,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:26:50,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:50,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:50,045::__init__::225::IOProcess::(_processLogs) (14748) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:50,045::__init__::225::IOProcess::(_processLogs) (14748) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:50,045::__init__::225::IOProcess::(_processLogs) (14748) Building response >Thread-25::DEBUG::2014-08-12 15:26:50,045::__init__::225::IOProcess::(_processLogs) (14748) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:50,045::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:50,046::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:26:50,047::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:26:50,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:26:50,047::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:26:50,047::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:26:50,047::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:26:50,047::__init__::225::IOProcess::(_processLogs) (14749) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:26:50,048::__init__::225::IOProcess::(_processLogs) (14749) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:26:50,048::__init__::225::IOProcess::(_processLogs) (14749) Building response >Thread-25::DEBUG::2014-08-12 15:26:50,048::__init__::225::IOProcess::(_processLogs) (14749) Queuing response >Thread-25::DEBUG::2014-08-12 15:26:50,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:26:50,048::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-14::DEBUG::2014-08-12 15:26:50,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`09b0e49f-f4fe-464a-b5a7-06a4f13465ae`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:50,616::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:26:50,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731345', 'lastCheck': '0.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709469', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:26:50,623::task::1191::Storage.TaskManager.Task::(prepare) Task=`09b0e49f-f4fe-464a-b5a7-06a4f13465ae`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731345', 'lastCheck': '0.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709469', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:26:50,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`09b0e49f-f4fe-464a-b5a7-06a4f13465ae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:50,624::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:50,626::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:26:50,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:50,628::task::993::Storage.TaskManager.Task::(_decref) Task=`09b0e49f-f4fe-464a-b5a7-06a4f13465ae`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:50,633::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:50,645::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:26:50,700::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:50,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:50,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131538 s, 77.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-08-12 15:26:50,876::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:26:50,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`822007df-0bf7-4e39-b9a7-ac9c8b63c77f`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:26:50,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:26:50,894::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:50,895::task::1191::Storage.TaskManager.Task::(prepare) Task=`822007df-0bf7-4e39-b9a7-ac9c8b63c77f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:26:50,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`822007df-0bf7-4e39-b9a7-ac9c8b63c77f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:26:50,895::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:26:50,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:26:50,895::task::993::Storage.TaskManager.Task::(_decref) Task=`822007df-0bf7-4e39-b9a7-ac9c8b63c77f`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:26:50,907::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:26:50,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`61598abf-4076-4b5e-bea5-c55d3d9f044c`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:26:50,907::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:26:50,908::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`e48a962a-8b25-4fe6-89fd-6b1d2c379f89`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:26:50,908::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:26:50,908::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:26:50,909::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`e48a962a-8b25-4fe6-89fd-6b1d2c379f89`::Granted request >Thread-32::DEBUG::2014-08-12 15:26:50,909::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`61598abf-4076-4b5e-bea5-c55d3d9f044c`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:26:50,909::task::993::Storage.TaskManager.Task::(_decref) Task=`61598abf-4076-4b5e-bea5-c55d3d9f044c`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:26:50,922::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:50,922::task::1191::Storage.TaskManager.Task::(prepare) Task=`61598abf-4076-4b5e-bea5-c55d3d9f044c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:26:50,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`61598abf-4076-4b5e-bea5-c55d3d9f044c`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:26:50,922::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:26:50,922::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:26:50,923::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:26:50,923::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:26:50,923::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:26:50,923::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:26:50,924::task::993::Storage.TaskManager.Task::(_decref) Task=`61598abf-4076-4b5e-bea5-c55d3d9f044c`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:26:52,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:52,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128625 s, 79.6 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:54,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:54,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131981 s, 77.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-12 15:26:55,506::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 22. >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:55,657::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:55,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:26:55,676::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:26:56,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:57,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129491 s, 79.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:26:59,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:26:59,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012949 s, 79.1 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:26:59,386::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:26:59,400::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626978 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:27:00,050::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:27:00,061::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685376 s, 6.0 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:27:00,066::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:27:00,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:27:00,066::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-25::DEBUG::2014-08-12 15:27:00,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:27:00,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:27:00,067::__init__::225::IOProcess::(_processLogs) (14750) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:27:00,067::__init__::225::IOProcess::(_processLogs) (14750) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:27:00,067::__init__::225::IOProcess::(_processLogs) (14750) Building response >Thread-25::DEBUG::2014-08-12 15:27:00,067::__init__::225::IOProcess::(_processLogs) (14750) Queuing response >Thread-25::DEBUG::2014-08-12 15:27:00,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:27:00,068::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:27:00,069::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:27:00,069::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:27:00,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:27:00,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:27:00,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:27:00,069::__init__::225::IOProcess::(_processLogs) (14751) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:27:00,070::__init__::225::IOProcess::(_processLogs) (14751) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:27:00,070::__init__::225::IOProcess::(_processLogs) (14751) Building response >Thread-25::DEBUG::2014-08-12 15:27:00,070::__init__::225::IOProcess::(_processLogs) (14751) Queuing response >Thread-25::DEBUG::2014-08-12 15:27:00,070::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:27:00,070::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:00,683::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:00,684::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:00,700::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:27:00,938::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:27:00,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`b17e2319-b7d2-41c3-8f09-95ad16369989`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:27:00,939::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:27:00,973::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:27:00,974::task::1191::Storage.TaskManager.Task::(prepare) Task=`b17e2319-b7d2-41c3-8f09-95ad16369989`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:27:00,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`b17e2319-b7d2-41c3-8f09-95ad16369989`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:27:00,974::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:27:00,974::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:27:00,974::task::993::Storage.TaskManager.Task::(_decref) Task=`b17e2319-b7d2-41c3-8f09-95ad16369989`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:27:00,986::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:27:00,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b0bc453-a38f-4884-92d1-569c10902432`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:27:00,987::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:27:00,987::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ea7f489f-8a76-4078-bdb9-1f737f11c9e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:27:00,988::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:27:00,988::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:27:00,988::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ea7f489f-8a76-4078-bdb9-1f737f11c9e7`::Granted request >Thread-32::DEBUG::2014-08-12 15:27:00,988::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b0bc453-a38f-4884-92d1-569c10902432`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:27:00,989::task::993::Storage.TaskManager.Task::(_decref) Task=`4b0bc453-a38f-4884-92d1-569c10902432`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:27:01,001::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:27:01,001::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b0bc453-a38f-4884-92d1-569c10902432`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:27:01,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b0bc453-a38f-4884-92d1-569c10902432`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:27:01,002::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:27:01,002::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:27:01,002::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:27:01,002::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:27:01,002::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:27:01,002::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:27:01,003::task::993::Storage.TaskManager.Task::(_decref) Task=`4b0bc453-a38f-4884-92d1-569c10902432`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:27:01,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:27:01,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132156 s, 77.5 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:27:03,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:27:03,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131186 s, 78.1 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:27:05,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:27:05,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150948 s, 67.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:05,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:05,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:05,724::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:27:05,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f497a9c-fbfe-487f-93c8-ef2bf1bf7ea3`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:27:05,798::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-08-12 15:27:05,798::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685376', 'lastCheck': '5.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626978', 'lastCheck': '6.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:27:05,798::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f497a9c-fbfe-487f-93c8-ef2bf1bf7ea3`::finished: {'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685376', 'lastCheck': '5.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626978', 'lastCheck': '6.4', 'valid': True}} >Thread-14::DEBUG::2014-08-12 15:27:05,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f497a9c-fbfe-487f-93c8-ef2bf1bf7ea3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:27:05,799::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:27:05,799::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:27:05,799::task::993::Storage.TaskManager.Task::(_decref) Task=`5f497a9c-fbfe-487f-93c8-ef2bf1bf7ea3`::ref 0 aborting False >Thread-14::DEBUG::2014-08-12 15:27:05,822::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Dummy-31::DEBUG::2014-08-12 15:27:07,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:27:07,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131303 s, 78.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-08-12 15:27:09,402::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-08-12 15:27:09,414::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651688 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-31::DEBUG::2014-08-12 15:27:09,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:27:09,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130175 s, 78.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:27:10,072::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:27:10,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689212 s, 5.9 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-08-12 15:27:10,087::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-25::DEBUG::2014-08-12 15:27:10,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:27:10,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:27:10,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:27:10,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:27:10,087::__init__::225::IOProcess::(_processLogs) (14752) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:27:10,088::__init__::225::IOProcess::(_processLogs) (14752) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:27:10,088::__init__::225::IOProcess::(_processLogs) (14752) Queuing response >Thread-25::DEBUG::2014-08-12 15:27:10,088::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:27:10,088::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-25::DEBUG::2014-08-12 15:27:10,089::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-25::DEBUG::2014-08-12 15:27:10,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-25::DEBUG::2014-08-12 15:27:10,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-25::DEBUG::2014-08-12 15:27:10,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-25::DEBUG::2014-08-12 15:27:10,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-25::DEBUG::2014-08-12 15:27:10,090::__init__::225::IOProcess::(_processLogs) (14753) Finding callback 'access'... >Thread-25::DEBUG::2014-08-12 15:27:10,090::__init__::225::IOProcess::(_processLogs) (14753) Got request for method 'access' >Thread-25::DEBUG::2014-08-12 15:27:10,090::__init__::225::IOProcess::(_processLogs) (14753) Building response >Thread-25::DEBUG::2014-08-12 15:27:10,090::__init__::225::IOProcess::(_processLogs) (14753) Queuing response >Thread-25::DEBUG::2014-08-12 15:27:10,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-25::DEBUG::2014-08-12 15:27:10,091::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-44::DEBUG::2014-08-12 15:27:10,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`559fe4cd-fa10-4cc0-8eba-f5aef8249e26`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:27:10,388::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-44::INFO::2014-08-12 15:27:10,388::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:27:10,389::task::1191::Storage.TaskManager.Task::(prepare) Task=`559fe4cd-fa10-4cc0-8eba-f5aef8249e26`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-44::DEBUG::2014-08-12 15:27:10,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`559fe4cd-fa10-4cc0-8eba-f5aef8249e26`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:27:10,389::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:27:10,389::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:27:10,389::task::993::Storage.TaskManager.Task::(_decref) Task=`559fe4cd-fa10-4cc0-8eba-f5aef8249e26`::ref 0 aborting False >Thread-44::DEBUG::2014-08-12 15:27:10,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`4df9af62-594c-440e-8815-00aefeb55433`::moving from state init -> state preparing >Thread-44::INFO::2014-08-12 15:27:10,390::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-44::INFO::2014-08-12 15:27:10,390::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:27:10,390::task::1191::Storage.TaskManager.Task::(prepare) Task=`4df9af62-594c-440e-8815-00aefeb55433`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-44::DEBUG::2014-08-12 15:27:10,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`4df9af62-594c-440e-8815-00aefeb55433`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-08-12 15:27:10,390::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-08-12 15:27:10,391::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-08-12 15:27:10,391::task::993::Storage.TaskManager.Task::(_decref) Task=`4df9af62-594c-440e-8815-00aefeb55433`::ref 0 aborting False >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:10,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:10,731::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >GuestMonitor-vm_398664::DEBUG::2014-08-12 15:27:10,747::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Domain Metadata is not set >Thread-14::DEBUG::2014-08-12 15:27:11,018::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-14::DEBUG::2014-08-12 15:27:11,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`49ab16e9-bea5-42ee-ab00-1002e07c5960`::moving from state init -> state preparing >Thread-14::INFO::2014-08-12 15:27:11,019::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-14::INFO::2014-08-12 15:27:11,045::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:27:11,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`49ab16e9-bea5-42ee-ab00-1002e07c5960`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-14::DEBUG::2014-08-12 15:27:11,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`49ab16e9-bea5-42ee-ab00-1002e07c5960`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-08-12 15:27:11,045::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-08-12 15:27:11,045::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-08-12 15:27:11,045::task::993::Storage.TaskManager.Task::(_decref) Task=`49ab16e9-bea5-42ee-ab00-1002e07c5960`::ref 0 aborting False >Thread-32::DEBUG::2014-08-12 15:27:11,059::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-32::DEBUG::2014-08-12 15:27:11,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`933d7f8b-854d-4c54-a461-2414909f3820`::moving from state init -> state preparing >Thread-32::INFO::2014-08-12 15:27:11,060::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', options=None) >Thread-32::DEBUG::2014-08-12 15:27:11,060::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`da341407-2003-4d10-be16-098fb3b9c4ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-32::DEBUG::2014-08-12 15:27:11,060::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-32::DEBUG::2014-08-12 15:27:11,060::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-32::DEBUG::2014-08-12 15:27:11,061::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`da341407-2003-4d10-be16-098fb3b9c4ca`::Granted request >Thread-32::DEBUG::2014-08-12 15:27:11,061::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`933d7f8b-854d-4c54-a461-2414909f3820`::_resourcesAcquired: Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a (shared) >Thread-32::DEBUG::2014-08-12 15:27:11,061::task::993::Storage.TaskManager.Task::(_decref) Task=`933d7f8b-854d-4c54-a461-2414909f3820`::ref 1 aborting False >Thread-32::INFO::2014-08-12 15:27:11,074::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:27:11,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`933d7f8b-854d-4c54-a461-2414909f3820`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': '180aea8f-26ba-4e87-8a94-37d5469519bf:Active,a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'master_uuid': 'a217cac4-c442-4af7-9502-bfc17ca3271c', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'status': 'Active', 'diskfree': '22280142848', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'status': 'Active', 'diskfree': '38117834752', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-32::DEBUG::2014-08-12 15:27:11,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`933d7f8b-854d-4c54-a461-2414909f3820`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-08-12 15:27:11,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a': < ResourceRef 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', isValid: 'True' obj: 'None'>} >Thread-32::DEBUG::2014-08-12 15:27:11,074::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-08-12 15:27:11,075::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-32::DEBUG::2014-08-12 15:27:11,075::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-32::DEBUG::2014-08-12 15:27:11,075::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-32::DEBUG::2014-08-12 15:27:11,075::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-32::DEBUG::2014-08-12 15:27:11,075::task::993::Storage.TaskManager.Task::(_decref) Task=`933d7f8b-854d-4c54-a461-2414909f3820`::ref 0 aborting False >Dummy-31::DEBUG::2014-08-12 15:27:11,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-31::DEBUG::2014-08-12 15:27:11,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129521 s, 79.1 MB/s\n'; <rc> = 0 >MainThread::DEBUG::2014-08-12 15:27:12,493::vdsm::58::vds::(sigtermHandler) Received signal 15 >MainThread::DEBUG::2014-08-12 15:27:12,494::protocoldetector::133::vds.MultiProtocolAcceptor::(stop) Stopping Acceptor >MainThread::INFO::2014-08-12 15:27:12,494::__init__::557::jsonrpc.JsonRpcServer::(stop) Stopping JsonRPC Server >Detector thread::DEBUG::2014-08-12 15:27:12,494::protocoldetector::104::vds.MultiProtocolAcceptor::(_cleanup) Cleaning Acceptor >MainThread::INFO::2014-08-12 15:27:12,495::vmchannels::188::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-08-12 15:27:12,496::momIF::91::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-08-12 15:27:12,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`463d0f24-086c-4d7c-b412-26545e123fa3`::moving from state init -> state preparing >MainThread::INFO::2014-08-12 15:27:12,497::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-08-12 15:27:12,497::storageServer::706::Storage.ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2014-08-12 15:27:12,503::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a5d7edf7-ce59-4366-a8e2-00377a8218e6/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,505::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ac2399be-0ce6-4711-8aff-ebebdea192fc/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,507::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/88c66bc6-3d19-4b3c-a107-a2e49fafaa0a/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,508::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/983390a3-6821-4b0f-8a5b-6d9970641471/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,510::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/be124097-6053-41a6-96ad-308bbd3e5975/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,512::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/31413644-3fc7-4c05-a4fa-39238e692a05/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,513::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d48f91a4-7940-4046-8242-8bf8b5f2e108/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,515::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e8606dab-936a-43d0-88c2-72a8b78efc39/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,516::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/77ff3bad-a547-4128-beca-8329c327009b/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,518::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8626fb02-3697-43c3-9d49-b6f078f7362d/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,520::sp::375::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/master >VM Channels Listener::INFO::2014-08-12 15:27:12,525::vmchannels::183::vds::(run) VM channels listener thread has ended. >MainThread::DEBUG::2014-08-12 15:27:12,578::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/master (cwd None) >MainThread::DEBUG::2014-08-12 15:27:12,639::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/657e1c0a-a73d-4dc1-9484-1a6958cc1520/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,641::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68443538-af51-4708-b3f8-39f23d3e2ac1/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,642::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/063e63e9-c6d7-45a8-922c-a133e20caab7/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,643::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/47e32d6a-7725-460c-8f64-b81a97e5b071/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,645::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0e901a47-277d-4850-aa9a-089406229355/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,646::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5ccdd912-a6e7-484a-8fee-0a1dd8d3dd7d/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,647::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5af68fc5-095c-49ad-83b7-8ae90ce638d0/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,648::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a1448566-c494-490f-ab3a-b3668a523eb7/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,650::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d3df38a6-fb2c-4baf-958d-def8a1f0f1df/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,651::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fc0e060d-b06c-42ac-98f1-230998bc2ebd/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,652::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9eb6a212-e0f0-4036-997d-7504d1837b04/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,654::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/48f5242e-95e7-4bf9-afa6-4c25ac4369b9/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,655::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/54654f76-0e83-4dca-a23c-7e46a1f1227c/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,656::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7959c6e6-5ed4-4829-aa84-e1c786bc7933/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,658::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dca9b77a-d6d8-4083-9e33-71f8cd7671aa/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,659::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/886a231d-f29c-4b80-a726-a5e19e7e2fa5/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,660::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1290b39-4e19-4400-9781-fe53df2c6503/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,661::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/352061c1-4187-4aeb-b595-42ac09e2d8b5/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,663::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/22b86714-a7ac-4951-b3b2-ed2731f23150/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:27:12,664::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c0b2fe94-115e-4870-8461-23987f104d9a/master` is not mounted, skipping >Dummy-31::INFO::2014-08-12 15:27:15,494::storage_mailbox::792::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-24::INFO::2014-08-12 15:27:17,277::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-24::INFO::2014-08-12 15:27:17,278::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-24::DEBUG::2014-08-12 15:27:17,278::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8 (cwd None) >Thread-24::DEBUG::2014-08-12 15:27:17,294::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00601898 s, 681 kB/s\n'; <rc> = 0 >MainThread::INFO::2014-08-12 15:27:18,191::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::INFO::2014-08-12 15:27:18,191::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::DEBUG::2014-08-12 15:27:18,191::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::INFO::2014-08-12 15:27:18,191::clusterlock::206::Storage.SANLock::(releaseHostId) Releasing host id for domain a217cac4-c442-4af7-9502-bfc17ca3271c (id: 1) >Thread-16::DEBUG::2014-08-12 15:27:18,192::domainMonitor::184::Storage.DomainMonitorThread::(_monitorLoop) Unable to release the host id 1 for domain a217cac4-c442-4af7-9502-bfc17ca3271c >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 181, in _monitorLoop > self.domain.releaseHostId(self.hostId, unused=True) > File "/usr/share/vdsm/storage/sd.py", line 480, in releaseHostId > self._clusterLock.releaseHostId(hostId, async, unused) > File "/usr/share/vdsm/storage/clusterlock.py", line 213, in releaseHostId > raise se.ReleaseHostIdFailure(self._sdUUID, e) >ReleaseHostIdFailure: Cannot release host id: ('a217cac4-c442-4af7-9502-bfc17ca3271c', SanlockException(16, 'Sanlock lockspace remove failure', 'Device or resource busy')) >MainThread::INFO::2014-08-12 15:27:18,199::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-33::DEBUG::2014-08-12 15:27:18,199::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-33::INFO::2014-08-12 15:27:18,199::clusterlock::206::Storage.SANLock::(releaseHostId) Releasing host id for domain 180aea8f-26ba-4e87-8a94-37d5469519bf (id: 1) >Thread-33::DEBUG::2014-08-12 15:27:20,200::clusterlock::216::Storage.SANLock::(releaseHostId) Host id for domain 180aea8f-26ba-4e87-8a94-37d5469519bf released successfully (id: 1) >MainThread::DEBUG::2014-08-12 15:27:20,200::taskManager::90::Storage.TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2014-08-12 15:27:20,201::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2014-08-12 15:27:20,201::task::1191::Storage.TaskManager.Task::(prepare) Task=`463d0f24-086c-4d7c-b412-26545e123fa3`::finished: None >MainThread::DEBUG::2014-08-12 15:27:20,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`463d0f24-086c-4d7c-b412-26545e123fa3`::moving from state preparing -> state finished >MainThread::DEBUG::2014-08-12 15:27:20,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-08-12 15:27:20,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-08-12 15:27:20,201::task::993::Storage.TaskManager.Task::(_decref) Task=`463d0f24-086c-4d7c-b412-26545e123fa3`::ref 0 aborting False >MainThread::INFO::2014-08-12 15:27:20,202::vdsm::137::vds::(run) VDSM main thread ended. Waiting for 17 other threads... >MainThread::INFO::2014-08-12 15:27:20,202::vdsm::141::vds::(run) <_MainThread(MainThread, started 139854913808128)> >MainThread::INFO::2014-08-12 15:27:20,202::vdsm::141::vds::(run) <Thread(libvirtEventLoop, started daemon 139854823560960)> >MainThread::INFO::2014-08-12 15:27:20,202::vdsm::141::vds::(run) <WorkerThread(a42a51fc-2609-4b47-9649-4888657dacae, started daemon 139854335702784)> >MainThread::INFO::2014-08-12 15:27:20,202::vdsm::141::vds::(run) <WorkerThread(23e51f0d-a2b8-4a0c-9b57-f29d9e89d3d0, started daemon 139854304233216)> >MainThread::INFO::2014-08-12 15:27:20,202::vdsm::141::vds::(run) <WorkerThread(08d369c6-4919-4174-8de4-644336a705eb, started daemon 139854738355968)> >MainThread::INFO::2014-08-12 15:27:20,203::vdsm::141::vds::(run) <WorkerThread(ada9d156-03f8-4b11-894a-a32ecb7d5872, started daemon 139854685906688)> >MainThread::INFO::2014-08-12 15:27:20,203::vdsm::141::vds::(run) <Thread(Thread-25, started daemon 139852739749632)> >MainThread::INFO::2014-08-12 15:27:20,203::vdsm::141::vds::(run) <WorkerThread(30fb1ef3-b7b0-4e24-8bbd-0b983ea49eaa, started daemon 139854706886400)> >MainThread::INFO::2014-08-12 15:27:20,203::vdsm::141::vds::(run) <WorkerThread(d9ae1b9a-2276-409c-99ef-2f0bb655b81d, started daemon 139854717376256)> >MainThread::INFO::2014-08-12 15:27:20,203::vdsm::141::vds::(run) <Thread(Thread-14, started daemon 139854283253504)> >MainThread::INFO::2014-08-12 15:27:20,203::vdsm::141::vds::(run) <WorkerThread(5d0888b2-f056-46a4-8d5c-5da6450a5afe, started daemon 139854727866112)> >MainThread::INFO::2014-08-12 15:27:20,203::vdsm::141::vds::(run) <WorkerThread(5f45b8e5-2bf2-4975-8e32-6d6df6debab1, started daemon 139854696396544)> >MainThread::INFO::2014-08-12 15:27:20,204::vdsm::141::vds::(run) <Thread(Thread-38, started daemon 139853163382528)> >MainThread::INFO::2014-08-12 15:27:20,204::vdsm::141::vds::(run) <_DummyThread(Dummy-31, started daemon 139852269987584)> >MainThread::INFO::2014-08-12 15:27:20,204::vdsm::141::vds::(run) <WorkerThread(94b41d4f-e515-49b8-9284-c5994008483e, started daemon 139854314723072)> >MainThread::INFO::2014-08-12 15:27:20,204::vdsm::141::vds::(run) <WorkerThread(e82f9670-2564-4647-ae8e-294e0fe98ea5, started daemon 139854325212928)> >MainThread::DEBUG::2014-08-12 15:27:20,204::sampling::406::vm.Vm::(stop) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Stop statistics collection >MainThread::INFO::2014-08-12 15:27:20,204::vdsm::141::vds::(run) <VmStatsThread(Thread-44, started daemon 139851810715392)> >Thread-44::DEBUG::2014-08-12 15:27:20,204::sampling::437::vm.Vm::(run) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Stats thread finished >MainThread::INFO::2014-08-12 15:27:20,205::vdsm::141::vds::(run) <Thread(Thread-32, started daemon 139851852674816)> >MainThread::INFO::2014-08-12 15:28:22,714::vdsm::131::vds::(run) (PID: 16325) I am the actual vdsm 4.16.1-6.gita4a4614.el6 master-vds12.qa.lab.tlv.redhat.com (2.6.32-431.20.3.el6.x86_64) >MainThread::DEBUG::2014-08-12 15:28:22,715::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-08-12 15:28:22,715::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500 >MainThread::DEBUG::2014-08-12 15:28:22,719::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt >MainThread::WARNING::2014-08-12 15:28:22,719::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-08-12 15:28:22,726::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a5d7edf7-ce59-4366-a8e2-00377a8218e6/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,728::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ac2399be-0ce6-4711-8aff-ebebdea192fc/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,729::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/88c66bc6-3d19-4b3c-a107-a2e49fafaa0a/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,730::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/983390a3-6821-4b0f-8a5b-6d9970641471/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,731::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/be124097-6053-41a6-96ad-308bbd3e5975/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,733::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/31413644-3fc7-4c05-a4fa-39238e692a05/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,734::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d48f91a4-7940-4046-8242-8bf8b5f2e108/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,735::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/e8606dab-936a-43d0-88c2-72a8b78efc39/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,737::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/77ff3bad-a547-4128-beca-8329c327009b/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,738::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/8626fb02-3697-43c3-9d49-b6f078f7362d/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,739::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,740::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/657e1c0a-a73d-4dc1-9484-1a6958cc1520/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,741::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/68443538-af51-4708-b3f8-39f23d3e2ac1/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,743::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/063e63e9-c6d7-45a8-922c-a133e20caab7/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,744::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/47e32d6a-7725-460c-8f64-b81a97e5b071/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,745::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/0e901a47-277d-4850-aa9a-089406229355/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,746::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5ccdd912-a6e7-484a-8fee-0a1dd8d3dd7d/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,748::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/5af68fc5-095c-49ad-83b7-8ae90ce638d0/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,749::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/a1448566-c494-490f-ab3a-b3668a523eb7/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,750::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d3df38a6-fb2c-4baf-958d-def8a1f0f1df/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,751::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fc0e060d-b06c-42ac-98f1-230998bc2ebd/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,753::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/9eb6a212-e0f0-4036-997d-7504d1837b04/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,754::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/48f5242e-95e7-4bf9-afa6-4c25ac4369b9/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,755::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/54654f76-0e83-4dca-a23c-7e46a1f1227c/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,756::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/7959c6e6-5ed4-4829-aa84-e1c786bc7933/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,758::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/dca9b77a-d6d8-4083-9e33-71f8cd7671aa/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,759::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/886a231d-f29c-4b80-a726-a5e19e7e2fa5/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,760::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/d1290b39-4e19-4400-9781-fe53df2c6503/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,761::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/352061c1-4187-4aeb-b595-42ac09e2d8b5/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,763::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/22b86714-a7ac-4951-b3b2-ed2731f23150/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,764::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c0b2fe94-115e-4870-8461-23987f104d9a/master` is not mounted, skipping >MainThread::DEBUG::2014-08-12 15:28:22,886::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-08-12 15:28:22,905::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-08-12 15:28:22,905::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type (cwd None) >MainThread::DEBUG::2014-08-12 15:28:23,093::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-08-12 15:28:23,094::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-08-12 15:28:23,096::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-08-12 15:28:23,096::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-08-12 15:28:23,096::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-08-12 15:28:23,098::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-08-12 15:28:23,099::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-08-12 15:28:23,103::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-08-12 15:28:23,104::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-08-12 15:28:23,132::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-08-12 15:28:23,134::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-08-12 15:28:23,140::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-08-12 15:28:23,145::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >MainThread::DEBUG::2014-08-12 15:28:23,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad97a85a-c686-41c3-bf18-b3f1747c9134`::moving from state init -> state preparing >MainThread::INFO::2014-08-12 15:28:23,190::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x1d6ced0>>) >MainThread::INFO::2014-08-12 15:28:23,190::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-08-12 15:28:23,190::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad97a85a-c686-41c3-bf18-b3f1747c9134`::finished: None >MainThread::DEBUG::2014-08-12 15:28:23,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad97a85a-c686-41c3-bf18-b3f1747c9134`::moving from state preparing -> state finished >MainThread::DEBUG::2014-08-12 15:28:23,190::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-08-12 15:28:23,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-08-12 15:28:23,191::task::993::Storage.TaskManager.Task::(_decref) Task=`ad97a85a-c686-41c3-bf18-b3f1747c9134`::ref 0 aborting False >MainThread::INFO::2014-08-12 15:28:23,191::momIF::49::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-08-12 15:28:23,195::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-08-12 15:28:23,197::vmchannels::175::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-08-12 15:28:23,206::libvirtconnection::150::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-08-12 15:28:23,210::misc::751::Storage.SamplingMethod::(__call__) Returning last result >MainThread::DEBUG::2014-08-12 15:28:23,213::protocoldetector::129::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x1e9f3b0> >storageRefresh::DEBUG::2014-08-12 15:28:23,264::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >MainThread::DEBUG::2014-08-12 15:28:23,323::protocoldetector::129::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x20c71b8> >JsonRpcServer::DEBUG::2014-08-12 15:28:23,324::__init__::498::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-08-12 15:28:23,330::protocoldetector::68::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running >Detector thread::DEBUG::2014-08-12 15:28:23,345::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=11 >clientIFinit::DEBUG::2014-08-12 15:28:23,366::clientIF::545::vds::(_recoverVm) Trying to recover 934767dd-bbad-4f2e-a372-28aef807713a >clientIFinit::INFO::2014-08-12 15:28:23,367::clientIF::391::vds::(createVm) vmContainerLock acquired by vm 934767dd-bbad-4f2e-a372-28aef807713a >clientIFinit::DEBUG::2014-08-12 15:28:23,374::libvirtconnection::150::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-08-12 15:28:23,386::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-08-12 15:28:23,389::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,393::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,398::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,404::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,409::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,412::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,415::misc::751::Storage.SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-08-12 15:28:23,418::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,446::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None) >clientIFinit::DEBUG::2014-08-12 15:28:23,472::clientIF::404::vds::(createVm) Total desktops after creation of 934767dd-bbad-4f2e-a372-28aef807713a is 1 >Thread-13::DEBUG::2014-08-12 15:28:23,472::vm::2228::vm.Vm::(_startUnderlyingVm) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Start >Thread-13::DEBUG::2014-08-12 15:28:23,475::vm::2232::vm.Vm::(_startUnderlyingVm) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::_ongoingCreations acquired >Thread-13::INFO::2014-08-12 15:28:23,478::vm::3224::vm.Vm::(_run) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::VM wrapper has started >Thread-13::WARNING::2014-08-12 15:28:23,479::vm::2020::vm.Vm::(buildConfDevices) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}' found >Thread-13::WARNING::2014-08-12 15:28:23,479::vm::2020::vm.Vm::(buildConfDevices) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}' found >Thread-13::WARNING::2014-08-12 15:28:23,480::vm::2020::vm.Vm::(buildConfDevices) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Unknown type found, device: '{'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}' found >Thread-13::DEBUG::2014-08-12 15:28:23,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed6421dd-4172-4f93-97c6-7f6d37554d02`::moving from state init -> state preparing >Thread-13::INFO::2014-08-12 15:28:23,482::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >Thread-13::ERROR::2014-08-12 15:28:23,483::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-13::ERROR::2014-08-12 15:28:23,483::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-13::DEBUG::2014-08-12 15:28:23,484::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-13::DEBUG::2014-08-12 15:28:23,485::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-13::DEBUG::2014-08-12 15:28:23,690::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-08-12 15:28:23,690::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-13::DEBUG::2014-08-12 15:28:23,690::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-13::DEBUG::2014-08-12 15:28:23,699::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000396501 s, 5.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-08-12 15:28:23,699::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000396501 s, 5.2 MB/s'], size: 2048 >Thread-13::DEBUG::2014-08-12 15:28:23,699::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-13::DEBUG::2014-08-12 15:28:23,699::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-13::DEBUG::2014-08-12 15:28:23,700::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-13::DEBUG::2014-08-12 15:28:23,700::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >storageRefresh::DEBUG::2014-08-12 15:28:23,705::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-08-12 15:28:23,705::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-08-12 15:28:23,706::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,706::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... >Thread-13::DEBUG::2014-08-12 15:28:23,706::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,707::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,707::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-13::DEBUG::2014-08-12 15:28:23,708::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >storageRefresh::DEBUG::2014-08-12 15:28:23,898::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-08-12 15:28:23,899::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:23,900::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None) >Thread-13::DEBUG::2014-08-12 15:28:23,900::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-08-12 15:28:23,907::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-08-12 15:28:23,907::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-13::DEBUG::2014-08-12 15:28:23,908::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS' >Thread-13::DEBUG::2014-08-12 15:28:23,909::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS' >Thread-13::DEBUG::2014-08-12 15:28:23,909::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS' >Thread-13::INFO::2014-08-12 15:28:23,910::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-13::DEBUG::2014-08-12 15:28:23,910::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed6421dd-4172-4f93-97c6-7f6d37554d02`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-13::DEBUG::2014-08-12 15:28:23,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed6421dd-4172-4f93-97c6-7f6d37554d02`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-08-12 15:28:23,911::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-08-12 15:28:23,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-08-12 15:28:23,911::task::993::Storage.TaskManager.Task::(_decref) Task=`ed6421dd-4172-4f93-97c6-7f6d37554d02`::ref 0 aborting False >Thread-13::DEBUG::2014-08-12 15:28:23,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`26fb5a40-94c8-4983-9ae5-dab19be6ee7d`::moving from state init -> state preparing >Thread-13::INFO::2014-08-12 15:28:23,912::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >Thread-13::INFO::2014-08-12 15:28:23,912::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-13::DEBUG::2014-08-12 15:28:23,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`26fb5a40-94c8-4983-9ae5-dab19be6ee7d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-13::DEBUG::2014-08-12 15:28:23,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`26fb5a40-94c8-4983-9ae5-dab19be6ee7d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-08-12 15:28:23,912::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-08-12 15:28:23,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-08-12 15:28:23,913::task::993::Storage.TaskManager.Task::(_decref) Task=`26fb5a40-94c8-4983-9ae5-dab19be6ee7d`::ref 0 aborting False >Thread-13::DEBUG::2014-08-12 15:28:23,916::vm::1035::vm.Vm::(__init__) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Ignoring param (target, 1048576) in BalloonDevice >Thread-13::DEBUG::2014-08-12 15:28:23,969::vm::5190::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-13::DEBUG::2014-08-12 15:28:23,970::vm::5211::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-13::DEBUG::2014-08-12 15:28:23,970::vm::5230::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Matched {'name': (u'hdc', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, None), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, None), 'path': ('', None), 'type': (u'cdrom', None)} >Thread-13::DEBUG::2014-08-12 15:28:23,970::vm::5190::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f6ce010c200>], 'readonly': False, 'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'type': u'disk'} >Thread-13::DEBUG::2014-08-12 15:28:23,971::vm::5211::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f6ce010c200>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf'), 'type': (u'disk', u'disk')} >Thread-13::DEBUG::2014-08-12 15:28:23,971::vm::5230::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Matched {'name': (u'vda', None), 'bootOrder': (u'1', None), 'boot': ([<DOM Element: boot at 0x7f6ce010c200>], None), 'readonly': (False, None), 'address': ({u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, None), 'path': (u'/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', None), 'type': (u'disk', None)} >Thread-13::DEBUG::2014-08-12 15:28:23,971::vm::5190::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Looking for drive with attributes {'name': u'vdb', 'bootOrder': '', 'boot': [], 'readonly': False, 'address': {u'slot': u'0x0b', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'type': u'disk'} >Thread-13::DEBUG::2014-08-12 15:28:23,971::vm::5211::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Matched {'name': (u'vdb', u'vdb'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, False), 'address': ({u'slot': u'0x0b', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x0b', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48'), 'type': (u'disk', u'disk')} >Thread-13::DEBUG::2014-08-12 15:28:23,972::vm::5230::vm.Vm::(_getUnderlyingDriveInfo) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Matched {'name': (u'vdb', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, None), 'address': ({u'slot': u'0x0b', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, None), 'path': (u'/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', None), 'type': (u'disk', None)} >Thread-13::DEBUG::2014-08-12 15:28:24,050::vm::1357::vm.Vm::(blockDev) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Unable to determine if the path '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf' is a block device >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 1354, in blockDev > self._blockDev = utils.isBlockDevice(self.path) > File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 104, in isBlockDevice > return stat.S_ISBLK(os.stat(path).st_mode) >OSError: [Errno 2] No such file or directory: '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf' >Thread-13::INFO::2014-08-12 15:28:24,052::vm::2251::vm.Vm::(_startUnderlyingVm) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Skipping errors on recovery >Traceback (most recent call last): > File "/usr/share/vdsm/virt/vm.py", line 2235, in _startUnderlyingVm > self._run() > File "/usr/share/vdsm/virt/vm.py", line 3298, in _run > self._domDependentInit() > File "/usr/share/vdsm/virt/vm.py", line 3189, in _domDependentInit > self._syncVolumeChain(drive) > File "/usr/share/vdsm/virt/vm.py", line 5660, in _syncVolumeChain > volumes = self._driveGetActualVolumeChain(drive) > File "/usr/share/vdsm/virt/vm.py", line 5639, in _driveGetActualVolumeChain > sourceAttr = ('file', 'dev')[drive.blockDev] >TypeError: tuple indices must be integers, not NoneType >Thread-13::DEBUG::2014-08-12 15:28:24,053::vm::2254::vm.Vm::(_startUnderlyingVm) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::_ongoingCreations released >storageRefresh::DEBUG::2014-08-12 15:28:24,104::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-08-12 15:28:24,105::lvm::653::Storage.LVM::(bootstrap) Skipping open lv: vg=180aea8f-26ba-4e87-8a94-37d5469519bf lv=7169f8be-d731-430e-b21e-adaf5afae8bb >storageRefresh::DEBUG::2014-08-12 15:28:24,105::lvm::653::Storage.LVM::(bootstrap) Skipping open lv: vg=180aea8f-26ba-4e87-8a94-37d5469519bf lv=5d36a899-c0fe-4a65-b16d-767ab4c1fd48 >storageRefresh::DEBUG::2014-08-12 15:28:24,105::lvm::653::Storage.LVM::(bootstrap) Skipping open lv: vg=180aea8f-26ba-4e87-8a94-37d5469519bf lv=003139aa-00e5-460f-8895-a675bb051afa >storageRefresh::DEBUG::2014-08-12 15:28:24,106::lvm::653::Storage.LVM::(bootstrap) Skipping open lv: vg=180aea8f-26ba-4e87-8a94-37d5469519bf lv=e16cb2fc-9c26-4d3e-b170-6d4728e117cf >storageRefresh::DEBUG::2014-08-12 15:28:24,106::lvm::653::Storage.LVM::(bootstrap) Skipping open lv: vg=180aea8f-26ba-4e87-8a94-37d5469519bf lv=9a5096b4-65cc-465b-9e86-54aaf67073a7 >storageRefresh::DEBUG::2014-08-12 15:28:24,106::lvm::653::Storage.LVM::(bootstrap) Skipping open lv: vg=180aea8f-26ba-4e87-8a94-37d5469519bf lv=7fa014f5-6f3d-4254-a67a-3f09d1689e44 >storageRefresh::DEBUG::2014-08-12 15:28:24,106::lvm::653::Storage.LVM::(bootstrap) Skipping open lv: vg=180aea8f-26ba-4e87-8a94-37d5469519bf lv=354f2204-1187-4dcc-be3c-93cc95d28ee8 >storageRefresh::INFO::2014-08-12 15:28:24,106::lvm::668::Storage.LVM::(bootstrap) Refreshing lvs: vg=180aea8f-26ba-4e87-8a94-37d5469519bf lvs=['outbox', 'master', 'metadata', 'inbox', 'leases', 'ids'] >storageRefresh::DEBUG::2014-08-12 15:28:24,106::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --refresh 180aea8f-26ba-4e87-8a94-37d5469519bf/outbox 180aea8f-26ba-4e87-8a94-37d5469519bf/master 180aea8f-26ba-4e87-8a94-37d5469519bf/metadata 180aea8f-26ba-4e87-8a94-37d5469519bf/inbox 180aea8f-26ba-4e87-8a94-37d5469519bf/leases 180aea8f-26ba-4e87-8a94-37d5469519bf/ids (cwd None) >storageRefresh::DEBUG::2014-08-12 15:28:24,463::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-08-12 15:28:24,463::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:24,464::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:24,464::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:24,464::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >clientIFinit::DEBUG::2014-08-12 15:28:24,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b74adb8-3423-4036-9269-5f4feaf638fc`::moving from state init -> state preparing >clientIFinit::INFO::2014-08-12 15:28:24,481::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-08-12 15:28:24,481::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-08-12 15:28:24,481::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b74adb8-3423-4036-9269-5f4feaf638fc`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-08-12 15:28:24,481::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b74adb8-3423-4036-9269-5f4feaf638fc`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-08-12 15:28:24,482::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-08-12 15:28:24,482::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-08-12 15:28:24,482::task::993::Storage.TaskManager.Task::(_decref) Task=`9b74adb8-3423-4036-9269-5f4feaf638fc`::ref 0 aborting False >storageRefresh::DEBUG::2014-08-12 15:28:24,633::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-08-12 15:28:24,634::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >storageRefresh::DEBUG::2014-08-12 15:28:24,634::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::INFO::2014-08-12 15:28:24,634::lvm::668::Storage.LVM::(bootstrap) Refreshing lvs: vg=a217cac4-c442-4af7-9502-bfc17ca3271c lvs=['metadata', 'ids', 'inbox', 'outbox', 'leases', 'master'] >storageRefresh::DEBUG::2014-08-12 15:28:24,635::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --refresh a217cac4-c442-4af7-9502-bfc17ca3271c/metadata a217cac4-c442-4af7-9502-bfc17ca3271c/ids a217cac4-c442-4af7-9502-bfc17ca3271c/inbox a217cac4-c442-4af7-9502-bfc17ca3271c/outbox a217cac4-c442-4af7-9502-bfc17ca3271c/leases a217cac4-c442-4af7-9502-bfc17ca3271c/master (cwd None) >storageRefresh::DEBUG::2014-08-12 15:28:24,942::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-08-12 15:28:24,943::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:24,943::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-08-12 15:28:24,943::hsm::387::Storage.HSM::(storageRefresh) HSM is ready >Detector thread::DEBUG::2014-08-12 15:28:25,361::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.161.45:48449 >Detector thread::DEBUG::2014-08-12 15:28:25,361::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.161.45:48449 >Detector thread::DEBUG::2014-08-12 15:28:25,362::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.161.45:48449 >Detector thread::DEBUG::2014-08-12 15:28:25,362::BindingXMLRPC::1167::XmlDetector::(handleSocket) xml over http detected from ('10.35.161.45', 48449) >Thread-15::DEBUG::2014-08-12 15:28:25,364::BindingXMLRPC::1127::vds::(wrapper) client [10.35.161.45]::call getCapabilities with () {} flowID [3c47e5ff] >Thread-15::DEBUG::2014-08-12 15:28:25,429::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,440::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,463::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,478::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,479::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/SNPd953UAse1Ys0/bonding/mode (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,491::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,493::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/SNPd953UAse1Ys0/bonding/mode (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,504::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,506::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/SNPd953UAse1Ys0/bonding/mode (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,518::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,519::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/SNPd953UAse1Ys0/bonding/mode (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,531::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,533::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/SNPd953UAse1Ys0/bonding/mode (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,544::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,545::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/SNPd953UAse1Ys0/bonding/mode (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,557::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,558::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/SNPd953UAse1Ys0/bonding/mode (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,569::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,571::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,610::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,634::caps::614::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.10 required >= 0.10.2-31 >Thread-15::DEBUG::2014-08-12 15:28:25,635::utils::738::root::(execCmd) numactl --hardware (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,642::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,643::utils::738::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:25,648::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:25,656::BindingXMLRPC::1134::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:master-vds12'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.20.3.el6.x86_64', 'buildtime': 1402068654.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '6.gita4a4614.el6', 'buildtime': 1407224890L, 'version': '4.16.1'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1407344452L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.10', 'buildtime': 1404226967L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1407344452L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'numaNodeDistance': {'1': [21, 10], '0': [10, 21]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.64.87', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'bridged': True, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:f408/64'], 'gateway': '10.35.64.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.64.87/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.64.87', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:f408/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.64.87/24'], 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '144', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.5cf3fc78f408', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.5cf3fc78f408', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '44', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'b9bbc465-81d0-428c-bed9-afd95b42eb94', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'e85e3b1e-c8ce-4a6d-939a-d495770a543d', 'DHCP_HOSTNAME': 'master-vds12.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:F4:0A', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '5c:f3:fc:78:f4:0a', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '5c:f3:fc:78:f4:08', 'DEVICE': 'eth0', 'ONBOOT': 'no'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:f408/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '5c:f3:fc:78:f4:08', 'speed': 1000}}, 'software_revision': '6', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:master-vds12', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '24017', 'cpuSpeed': '2527.000', 'numaNodes': {u'1': {'totalMemory': '12288', 'cpus': [6, 7, 8, 9, 10, 11, 18, 19, 20, 21, 22, 23]}, u'0': {'totalMemory': '12276', 'cpus': [0, 1, 2, 3, 4, 5, 12, 13, 14, 15, 16, 17]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.161.45'}} >Thread-15::DEBUG::2014-08-12 15:28:25,674::BindingXMLRPC::1127::vds::(wrapper) client [10.35.161.45]::call getHardwareInfo with () {} flowID [3c47e5ff] >Thread-15::DEBUG::2014-08-12 15:28:25,759::BindingXMLRPC::1134::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'BladeCenter HS22 -[7870A7G]-', 'systemSerialNumber': '06EXY58', 'systemFamily': 'System x', 'systemVersion': '07', 'systemUUID': '893e428e-c28b-11e0-a68e-5cf3fc78f408', 'systemManufacturer': 'IBM'}} >Thread-15::DEBUG::2014-08-12 15:28:25,875::BindingXMLRPC::1127::vds::(wrapper) client [10.35.161.45]::call vmGetStats with ('934767dd-bbad-4f2e-a372-28aef807713a',) {} flowID [25d7b5f1] >Thread-15::DEBUG::2014-08-12 15:28:25,875::BindingXMLRPC::1134::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Paused', 'displayInfo': [{'tlsPort': u'5901', 'ipAddress': '10.35.64.87', 'type': 'spice', 'port': u'5900'}], 'hash': '3972941371866967112', 'acpiEnable': 'true', 'pid': '28742', 'displayIp': '10.35.64.87', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'timeOffset': '0', 'kvmEnable': 'true', 'network': {}, 'vmId': '934767dd-bbad-4f2e-a372-28aef807713a', 'vmType': 'kvm', 'disks': {}, 'monitorResponse': '0', 'elapsedTime': '16171', 'displayType': 'qxl', 'clientIp': ''}]} >Thread-15::DEBUG::2014-08-12 15:28:26,120::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [17e5a6f7] >Thread-15::DEBUG::2014-08-12 15:28:26,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5c6ad11-ce4f-4314-8dc3-c0baf82ef90f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:28:26,121::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', conList=[{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e40e8f9e-8ff3-4053-b236-c7822ad964c5', 'port': '3260'}], options=None) >Thread-15::DEBUG::2014-08-12 15:28:26,122::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,156::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,156::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,170::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,170::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,183::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,183::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: ('180aea8f-26ba-4e87-8a94-37d5469519bf', 'a217cac4-c442-4af7-9502-bfc17ca3271c') >Thread-15::DEBUG::2014-08-12 15:28:26,183::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain} >Thread-15::INFO::2014-08-12 15:28:26,184::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'e40e8f9e-8ff3-4053-b236-c7822ad964c5'}]} >Thread-15::DEBUG::2014-08-12 15:28:26,184::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5c6ad11-ce4f-4314-8dc3-c0baf82ef90f`::finished: {'statuslist': [{'status': 0, 'id': 'e40e8f9e-8ff3-4053-b236-c7822ad964c5'}]} >Thread-15::DEBUG::2014-08-12 15:28:26,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5c6ad11-ce4f-4314-8dc3-c0baf82ef90f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:28:26,184::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:28:26,184::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:28:26,185::task::993::Storage.TaskManager.Task::(_decref) Task=`f5c6ad11-ce4f-4314-8dc3-c0baf82ef90f`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 15:28:26,205::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 15:28:26,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`afecc81a-7d30-4d6f-9a0f-7310c1431863`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:28:26,206::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 15:28:26,206::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`c3039f08-8317-40fa-82f7-35d258693e86`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 15:28:26,207::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 15:28:26,207::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 15:28:26,207::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`c3039f08-8317-40fa-82f7-35d258693e86`::Granted request >Thread-15::DEBUG::2014-08-12 15:28:26,208::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`63e95a53-0852-4922-bcaf-1e47d50b0b06`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 15:28:26,208::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 15:28:26,208::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 15:28:26,208::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`63e95a53-0852-4922-bcaf-1e47d50b0b06`::Granted request >Thread-15::DEBUG::2014-08-12 15:28:26,208::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 15:28:26,209::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::INFO::2014-08-12 15:28:26,209::sp::133::Storage.StoragePool::(setBackend) updating pool fb5f3025-b514-4fcb-a639-7daae48dfe1a backend from type NoneType instance 0x38f5f72210 to type StoragePoolMemoryBackend instance 0x7f6cb4364470 >Thread-15::INFO::2014-08-12 15:28:26,209::sp::631::Storage.StoragePool::(connect) Connect host #1 to the storage pool fb5f3025-b514-4fcb-a639-7daae48dfe1a with master domain: a217cac4-c442-4af7-9502-bfc17ca3271c (ver = 1) >Thread-15::DEBUG::2014-08-12 15:28:26,209::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,209::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,210::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,210::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,210::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,211::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,211::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 15:28:26,211::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 15:28:26,211::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 15:28:26,211::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 15:28:26,211::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 15:28:26,212::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,233::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 15:28:26,234::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,293::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,294::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,294::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,294::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,295::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,295::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,295::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,295::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 15:28:26,296::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,298::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,480::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,480::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,481::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 15:28:26,481::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,489::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000559842 s, 3.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,489::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000559842 s, 3.7 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 15:28:26,489::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 15:28:26,489::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 15:28:26,489::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 15:28:26,490::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,490::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,490::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,490::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,491::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,491::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,678::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,719::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,720::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::DEBUG::2014-08-12 15:28:26,721::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS' >Thread-15::DEBUG::2014-08-12 15:28:26,721::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS' >Thread-15::DEBUG::2014-08-12 15:28:26,721::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS' >Thread-15::DEBUG::2014-08-12 15:28:26,722::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 15:28:26,722::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 15:28:26,722::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 15:28:26,722::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 15:28:26,723::sp::1410::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` started monitoring domain `180aea8f-26ba-4e87-8a94-37d5469519bf` >Thread-16::DEBUG::2014-08-12 15:28:26,723::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::INFO::2014-08-12 15:28:26,724::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 15:28:26,726::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 15:28:26,726::sp::1410::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` started monitoring domain `a217cac4-c442-4af7-9502-bfc17ca3271c` >Thread-16::DEBUG::2014-08-12 15:28:26,727::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,729::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-08-12 15:28:26,730::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:28:26,731::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,731::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 15:28:26,746::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 15:28:26,748::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-15::DEBUG::2014-08-12 15:28:26,748::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 15:28:26,897::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:28:26,898::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:28:26,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000513132 s, 8.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:28:26,912::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain a217cac4-c442-4af7-9502-bfc17ca3271c changed its status to Valid >Thread-18::DEBUG::2014-08-12 15:28:26,913::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-18::DEBUG::2014-08-12 15:28:26,913::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-18::DEBUG::2014-08-12 15:28:26,914::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-19::INFO::2014-08-12 15:28:26,915::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >Thread-16::DEBUG::2014-08-12 15:28:26,923::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:28:26,923::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:28:26,923::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:28:26,931::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00124832 s, 1.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:28:26,932::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00124832 s, 1.6 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:28:26,932::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:28:26,932::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:28:26,932::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:28:26,933::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-15::DEBUG::2014-08-12 15:28:26,948::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,948::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,948::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 15:28:26,949::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 15:28:26,950::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-16::DEBUG::2014-08-12 15:28:26,950::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::WARNING::2014-08-12 15:28:26,950::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-15::INFO::2014-08-12 15:28:26,952::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 15:28:26,952::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,953::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 15:28:26,953::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 15:28:26,954::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 15:28:26,954::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 15:28:26,955::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 15:28:26,956::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-16::DEBUG::2014-08-12 15:28:26,956::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::INFO::2014-08-12 15:28:26,957::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 15:28:26,958::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::DEBUG::2014-08-12 15:28:26,958::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::INFO::2014-08-12 15:28:26,959::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 15:28:26,960::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-16::DEBUG::2014-08-12 15:28:26,960::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,961::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500 >Thread-15::DEBUG::2014-08-12 15:28:26,971::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd if=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8 (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,981::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00226602 s, 1.8 MB/s\n'; <rc> = 0 >Thread-15::INFO::2014-08-12 15:28:26,981::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-15::DEBUG::2014-08-12 15:28:26,982::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8 (cwd None) >Thread-15::DEBUG::2014-08-12 15:28:26,993::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00407791 s, 1.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:26,994::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::DEBUG::2014-08-12 15:28:26,995::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool fb5f3025-b514-4fcb-a639-7daae48dfe1a on master domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 15:28:26,995::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 15:28:26,996::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 15:28:26,996::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 15:28:26,996::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 15:28:26,996::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 15:28:26,996::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 15:28:26,996::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 15:28:26,997::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 15:28:26,997::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 15:28:26,997::task::1191::Storage.TaskManager.Task::(prepare) Task=`afecc81a-7d30-4d6f-9a0f-7310c1431863`::finished: True >Thread-15::DEBUG::2014-08-12 15:28:26,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`afecc81a-7d30-4d6f-9a0f-7310c1431863`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:28:26,997::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:28:26,998::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:28:26,998::task::993::Storage.TaskManager.Task::(_decref) Task=`afecc81a-7d30-4d6f-9a0f-7310c1431863`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 15:28:27,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`15db2724-58f8-4611-b448-d91658ed72d5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:28:27,042::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:28:27,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513132', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:28:27,043::task::1191::Storage.TaskManager.Task::(prepare) Task=`15db2724-58f8-4611-b448-d91658ed72d5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513132', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:28:27,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`15db2724-58f8-4611-b448-d91658ed72d5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:28:27,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:28:27,043::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:28:27,044::task::993::Storage.TaskManager.Task::(_decref) Task=`15db2724-58f8-4611-b448-d91658ed72d5`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 15:28:27,058::BindingXMLRPC::1127::vds::(wrapper) client [10.35.161.45]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': False},) {} flowID [17e5a6f7] >Thread-15::DEBUG::2014-08-12 15:28:27,142::BindingXMLRPC::1134::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-16::DEBUG::2014-08-12 15:28:27,145::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:28:27,145::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:28:27,145::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 15:28:27,146::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 15:28:27,146::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 15:28:27,146::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:28:27,147::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 15:28:27,315::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:28:27,315::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:28:27,324::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668721 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:28:27,325::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 180aea8f-26ba-4e87-8a94-37d5469519bf changed its status to Valid >Thread-16::INFO::2014-08-12 15:28:27,326::clusterlock::183::Storage.SANLock::(acquireHostId) Acquiring host id for domain 180aea8f-26ba-4e87-8a94-37d5469519bf (id: 1) >Thread-26::DEBUG::2014-08-12 15:28:27,326::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-26::DEBUG::2014-08-12 15:28:27,327::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-16::DEBUG::2014-08-12 15:28:27,327::clusterlock::201::Storage.SANLock::(acquireHostId) Host id for domain 180aea8f-26ba-4e87-8a94-37d5469519bf successfully acquired (id: 1) >Thread-26::DEBUG::2014-08-12 15:28:27,328::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-27::INFO::2014-08-12 15:28:27,330::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >clientIFinit::DEBUG::2014-08-12 15:28:29,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`249d96db-4f8a-427e-b442-9114f545d09f`::moving from state init -> state preparing >clientIFinit::INFO::2014-08-12 15:28:29,488::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-08-12 15:28:29,488::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': ['fb5f3025-b514-4fcb-a639-7daae48dfe1a']} >clientIFinit::DEBUG::2014-08-12 15:28:29,488::task::1191::Storage.TaskManager.Task::(prepare) Task=`249d96db-4f8a-427e-b442-9114f545d09f`::finished: {'poollist': ['fb5f3025-b514-4fcb-a639-7daae48dfe1a']} >clientIFinit::DEBUG::2014-08-12 15:28:29,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`249d96db-4f8a-427e-b442-9114f545d09f`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-08-12 15:28:29,489::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-08-12 15:28:29,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-08-12 15:28:29,489::task::993::Storage.TaskManager.Task::(_decref) Task=`249d96db-4f8a-427e-b442-9114f545d09f`::ref 0 aborting False >clientIFinit::WARNING::2014-08-12 15:28:29,489::vm::2020::vm.Vm::(buildConfDevices) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}' found >clientIFinit::WARNING::2014-08-12 15:28:29,491::vm::2020::vm.Vm::(buildConfDevices) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}' found >clientIFinit::WARNING::2014-08-12 15:28:29,491::vm::2020::vm.Vm::(buildConfDevices) vmId=`934767dd-bbad-4f2e-a372-28aef807713a`::Unknown type found, device: '{'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}' found >clientIFinit::DEBUG::2014-08-12 15:28:29,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`109b2cd9-9f4b-494d-a57a-e364a6976dc0`::moving from state init -> state preparing >clientIFinit::INFO::2014-08-12 15:28:29,491::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', volUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf', options=None) >clientIFinit::INFO::2014-08-12 15:28:29,492::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >clientIFinit::DEBUG::2014-08-12 15:28:29,492::task::1191::Storage.TaskManager.Task::(prepare) Task=`109b2cd9-9f4b-494d-a57a-e364a6976dc0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >clientIFinit::DEBUG::2014-08-12 15:28:29,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`109b2cd9-9f4b-494d-a57a-e364a6976dc0`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-08-12 15:28:29,492::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-08-12 15:28:29,492::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-08-12 15:28:29,493::task::993::Storage.TaskManager.Task::(_decref) Task=`109b2cd9-9f4b-494d-a57a-e364a6976dc0`::ref 0 aborting False >clientIFinit::DEBUG::2014-08-12 15:28:29,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`9285b785-1832-4d77-9ece-3239792ba6bb`::moving from state init -> state preparing >clientIFinit::INFO::2014-08-12 15:28:29,493::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', volUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48', options=None) >clientIFinit::INFO::2014-08-12 15:28:29,493::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >clientIFinit::DEBUG::2014-08-12 15:28:29,494::task::1191::Storage.TaskManager.Task::(prepare) Task=`9285b785-1832-4d77-9ece-3239792ba6bb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >clientIFinit::DEBUG::2014-08-12 15:28:29,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`9285b785-1832-4d77-9ece-3239792ba6bb`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-08-12 15:28:29,494::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-08-12 15:28:29,494::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-08-12 15:28:29,494::task::993::Storage.TaskManager.Task::(_decref) Task=`9285b785-1832-4d77-9ece-3239792ba6bb`::ref 0 aborting False >clientIFinit::INFO::2014-08-12 15:28:29,494::clientIF::332::vds::(prepareVolumePath) prepared volume path: >clientIFinit::DEBUG::2014-08-12 15:28:29,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`97e55aae-6840-4ae5-b8b8-9594560a518f`::moving from state init -> state preparing >clientIFinit::INFO::2014-08-12 15:28:29,495::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='b790c316-c040-4ed2-89d9-ace073387615', leafUUID='e16cb2fc-9c26-4d3e-b170-6d4728e117cf') >clientIFinit::DEBUG::2014-08-12 15:28:29,495::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`1423a89d-87b9-4f7a-bd32-ea582be775c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >clientIFinit::DEBUG::2014-08-12 15:28:29,495::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'shared' >clientIFinit::DEBUG::2014-08-12 15:28:29,496::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'shared' (1 active user) >clientIFinit::DEBUG::2014-08-12 15:28:29,496::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`1423a89d-87b9-4f7a-bd32-ea582be775c6`::Granted request >clientIFinit::DEBUG::2014-08-12 15:28:29,496::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`97e55aae-6840-4ae5-b8b8-9594560a518f`::_resourcesAcquired: Storage.180aea8f-26ba-4e87-8a94-37d5469519bf (shared) >clientIFinit::DEBUG::2014-08-12 15:28:29,496::task::993::Storage.TaskManager.Task::(_decref) Task=`97e55aae-6840-4ae5-b8b8-9594560a518f`::ref 1 aborting False >clientIFinit::DEBUG::2014-08-12 15:28:29,497::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >clientIFinit::DEBUG::2014-08-12 15:28:29,497::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >clientIFinit::DEBUG::2014-08-12 15:28:29,666::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >clientIFinit::DEBUG::2014-08-12 15:28:29,667::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >clientIFinit::DEBUG::2014-08-12 15:28:29,667::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >clientIFinit::DEBUG::2014-08-12 15:28:29,669::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615 >clientIFinit::WARNING::2014-08-12 15:28:29,669::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615 already exists >clientIFinit::DEBUG::2014-08-12 15:28:29,669::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/7169f8be-d731-430e-b21e-adaf5afae8bb to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615/7169f8be-d731-430e-b21e-adaf5afae8bb >clientIFinit::DEBUG::2014-08-12 15:28:29,670::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615/7169f8be-d731-430e-b21e-adaf5afae8bb >clientIFinit::DEBUG::2014-08-12 15:28:29,670::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/9a5096b4-65cc-465b-9e86-54aaf67073a7 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615/9a5096b4-65cc-465b-9e86-54aaf67073a7 >clientIFinit::DEBUG::2014-08-12 15:28:29,670::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615/9a5096b4-65cc-465b-9e86-54aaf67073a7 >clientIFinit::DEBUG::2014-08-12 15:28:29,670::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/e16cb2fc-9c26-4d3e-b170-6d4728e117cf to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf >clientIFinit::DEBUG::2014-08-12 15:28:29,670::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf >clientIFinit::DEBUG::2014-08-12 15:28:29,670::blockSD::1045::Storage.StorageDomain::(linkBCImage) Creating symlink from /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/b790c316-c040-4ed2-89d9-ace073387615 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615 >clientIFinit::DEBUG::2014-08-12 15:28:29,671::blockSD::1051::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615 >clientIFinit::INFO::2014-08-12 15:28:29,671::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'imgVolumesInfo': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/7169f8be-d731-430e-b21e-adaf5afae8bb', 'volumeID': '7169f8be-d731-430e-b21e-adaf5afae8bb', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/9a5096b4-65cc-465b-9e86-54aaf67073a7', 'volumeID': '9a5096b4-65cc-465b-9e86-54aaf67073a7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}]} >clientIFinit::DEBUG::2014-08-12 15:28:29,672::task::1191::Storage.TaskManager.Task::(prepare) Task=`97e55aae-6840-4ae5-b8b8-9594560a518f`::finished: {'info': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'imgVolumesInfo': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/7169f8be-d731-430e-b21e-adaf5afae8bb', 'volumeID': '7169f8be-d731-430e-b21e-adaf5afae8bb', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 113246208, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/9a5096b4-65cc-465b-9e86-54aaf67073a7', 'volumeID': '9a5096b4-65cc-465b-9e86-54aaf67073a7', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 117440512, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'volumeID': 'e16cb2fc-9c26-4d3e-b170-6d4728e117cf', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'b790c316-c040-4ed2-89d9-ace073387615'}]} >clientIFinit::DEBUG::2014-08-12 15:28:29,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`97e55aae-6840-4ae5-b8b8-9594560a518f`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-08-12 15:28:29,672::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>} >clientIFinit::DEBUG::2014-08-12 15:28:29,672::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-08-12 15:28:29,672::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' >clientIFinit::DEBUG::2014-08-12 15:28:29,673::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >clientIFinit::DEBUG::2014-08-12 15:28:29,673::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >clientIFinit::DEBUG::2014-08-12 15:28:29,673::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >clientIFinit::DEBUG::2014-08-12 15:28:29,673::task::993::Storage.TaskManager.Task::(_decref) Task=`97e55aae-6840-4ae5-b8b8-9594560a518f`::ref 0 aborting False >clientIFinit::INFO::2014-08-12 15:28:29,673::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/b790c316-c040-4ed2-89d9-ace073387615/e16cb2fc-9c26-4d3e-b170-6d4728e117cf >clientIFinit::DEBUG::2014-08-12 15:28:29,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6f27c10-561f-4623-84c9-91222d61f3fc`::moving from state init -> state preparing >clientIFinit::INFO::2014-08-12 15:28:29,674::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='180aea8f-26ba-4e87-8a94-37d5469519bf', spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', imgUUID='cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7', leafUUID='5d36a899-c0fe-4a65-b16d-767ab4c1fd48') >clientIFinit::DEBUG::2014-08-12 15:28:29,675::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`7a924932-1236-4643-8748-fa27b04ffb55`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >clientIFinit::DEBUG::2014-08-12 15:28:29,675::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' for lock type 'shared' >clientIFinit::DEBUG::2014-08-12 15:28:29,675::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free. Now locking as 'shared' (1 active user) >clientIFinit::DEBUG::2014-08-12 15:28:29,675::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.180aea8f-26ba-4e87-8a94-37d5469519bf`ReqID=`7a924932-1236-4643-8748-fa27b04ffb55`::Granted request >clientIFinit::DEBUG::2014-08-12 15:28:29,675::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c6f27c10-561f-4623-84c9-91222d61f3fc`::_resourcesAcquired: Storage.180aea8f-26ba-4e87-8a94-37d5469519bf (shared) >clientIFinit::DEBUG::2014-08-12 15:28:29,676::task::993::Storage.TaskManager.Task::(_decref) Task=`c6f27c10-561f-4623-84c9-91222d61f3fc`::ref 1 aborting False >clientIFinit::DEBUG::2014-08-12 15:28:29,676::lvm::419::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >clientIFinit::DEBUG::2014-08-12 15:28:29,676::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >clientIFinit::DEBUG::2014-08-12 15:28:29,845::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >clientIFinit::DEBUG::2014-08-12 15:28:29,846::lvm::454::Storage.LVM::(_reloadlvs) lvs reloaded >clientIFinit::DEBUG::2014-08-12 15:28:29,846::lvm::454::Storage.OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >clientIFinit::DEBUG::2014-08-12 15:28:29,847::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7 >clientIFinit::WARNING::2014-08-12 15:28:29,847::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7 already exists >clientIFinit::DEBUG::2014-08-12 15:28:29,847::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/5d36a899-c0fe-4a65-b16d-767ab4c1fd48 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48 >clientIFinit::DEBUG::2014-08-12 15:28:29,847::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48 >clientIFinit::DEBUG::2014-08-12 15:28:29,848::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/7fa014f5-6f3d-4254-a67a-3f09d1689e44 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/7fa014f5-6f3d-4254-a67a-3f09d1689e44 >clientIFinit::DEBUG::2014-08-12 15:28:29,848::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/7fa014f5-6f3d-4254-a67a-3f09d1689e44 >clientIFinit::DEBUG::2014-08-12 15:28:29,848::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/003139aa-00e5-460f-8895-a675bb051afa to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/003139aa-00e5-460f-8895-a675bb051afa >clientIFinit::DEBUG::2014-08-12 15:28:29,848::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/003139aa-00e5-460f-8895-a675bb051afa >clientIFinit::DEBUG::2014-08-12 15:28:29,848::blockSD::1075::Storage.StorageDomain::(createImageLinks) Creating symlink from /dev/180aea8f-26ba-4e87-8a94-37d5469519bf/354f2204-1187-4dcc-be3c-93cc95d28ee8 to /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/354f2204-1187-4dcc-be3c-93cc95d28ee8 >clientIFinit::DEBUG::2014-08-12 15:28:29,848::blockSD::1080::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/354f2204-1187-4dcc-be3c-93cc95d28ee8 >clientIFinit::DEBUG::2014-08-12 15:28:29,848::blockSD::1045::Storage.StorageDomain::(linkBCImage) Creating symlink from /var/run/vdsm/storage/180aea8f-26ba-4e87-8a94-37d5469519bf/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7 >clientIFinit::DEBUG::2014-08-12 15:28:29,849::blockSD::1051::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7 >clientIFinit::INFO::2014-08-12 15:28:29,850::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 121634816, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'imgVolumesInfo': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 121634816, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 110100480, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/7fa014f5-6f3d-4254-a67a-3f09d1689e44', 'volumeID': '7fa014f5-6f3d-4254-a67a-3f09d1689e44', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 114294784, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/003139aa-00e5-460f-8895-a675bb051afa', 'volumeID': '003139aa-00e5-460f-8895-a675bb051afa', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 118489088, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/354f2204-1187-4dcc-be3c-93cc95d28ee8', 'volumeID': '354f2204-1187-4dcc-be3c-93cc95d28ee8', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}]} >clientIFinit::DEBUG::2014-08-12 15:28:29,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6f27c10-561f-4623-84c9-91222d61f3fc`::finished: {'info': {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 121634816, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, 'path': '/rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'imgVolumesInfo': [{'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 121634816, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'volumeID': '5d36a899-c0fe-4a65-b16d-767ab4c1fd48', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 110100480, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/7fa014f5-6f3d-4254-a67a-3f09d1689e44', 'volumeID': '7fa014f5-6f3d-4254-a67a-3f09d1689e44', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 114294784, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/003139aa-00e5-460f-8895-a675bb051afa', 'volumeID': '003139aa-00e5-460f-8895-a675bb051afa', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}, {'domainID': '180aea8f-26ba-4e87-8a94-37d5469519bf', 'volType': 'path', 'leaseOffset': 118489088, 'path': '/rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/354f2204-1187-4dcc-be3c-93cc95d28ee8', 'volumeID': '354f2204-1187-4dcc-be3c-93cc95d28ee8', 'leasePath': '/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/leases', 'imageID': 'cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7'}]} >clientIFinit::DEBUG::2014-08-12 15:28:29,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6f27c10-561f-4623-84c9-91222d61f3fc`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-08-12 15:28:29,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf': < ResourceRef 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', isValid: 'True' obj: 'None'>} >clientIFinit::DEBUG::2014-08-12 15:28:29,850::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-08-12 15:28:29,851::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' >clientIFinit::DEBUG::2014-08-12 15:28:29,851::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' (0 active users) >clientIFinit::DEBUG::2014-08-12 15:28:29,851::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf' is free, finding out if anyone is waiting for it. >clientIFinit::DEBUG::2014-08-12 15:28:29,851::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.180aea8f-26ba-4e87-8a94-37d5469519bf', Clearing records. >clientIFinit::DEBUG::2014-08-12 15:28:29,851::task::993::Storage.TaskManager.Task::(_decref) Task=`c6f27c10-561f-4623-84c9-91222d61f3fc`::ref 0 aborting False >clientIFinit::INFO::2014-08-12 15:28:29,852::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf/images/cabeef01-f55b-4a22-bb0e-ebd8ad4d5bc7/5d36a899-c0fe-4a65-b16d-767ab4c1fd48 >Thread-17::DEBUG::2014-08-12 15:28:36,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:28:36,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115269 s, 3.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:28:37,330::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:28:37,339::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622404 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:39,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd707992-d691-4db8-ab22-21fdda55dfb5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:28:39,304::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:28:39,305::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000622404', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00115269', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:28:39,305::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd707992-d691-4db8-ab22-21fdda55dfb5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000622404', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00115269', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:28:39,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd707992-d691-4db8-ab22-21fdda55dfb5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:28:39,305::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:28:39,305::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:28:39,306::task::993::Storage.TaskManager.Task::(_decref) Task=`cd707992-d691-4db8-ab22-21fdda55dfb5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:28:46,937::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:28:46,945::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693428 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:28:47,340::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:28:47,347::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657911 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:28:54,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`d11cfdf0-0676-45ef-ae1a-4bdd48776d56`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:28:54,411::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:28:54,411::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000657911', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693428', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:28:54,411::task::1191::Storage.TaskManager.Task::(prepare) Task=`d11cfdf0-0676-45ef-ae1a-4bdd48776d56`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000657911', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693428', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:28:54,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`d11cfdf0-0676-45ef-ae1a-4bdd48776d56`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:28:54,412::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:28:54,412::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:28:54,412::task::993::Storage.TaskManager.Task::(_decref) Task=`d11cfdf0-0676-45ef-ae1a-4bdd48776d56`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:28:56,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:28:56,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069625 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:28:57,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:28:57,356::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629923 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:29:06,977::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:29:06,986::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000798932 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:29:07,357::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:29:07,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648176 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:29:09,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`79ab0ca4-c960-48e5-9e6b-979393a92f18`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:29:09,546::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:29:09,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648176', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000798932', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:29:09,547::task::1191::Storage.TaskManager.Task::(prepare) Task=`79ab0ca4-c960-48e5-9e6b-979393a92f18`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648176', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000798932', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:29:09,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`79ab0ca4-c960-48e5-9e6b-979393a92f18`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:29:09,547::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:29:09,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:29:09,547::task::993::Storage.TaskManager.Task::(_decref) Task=`79ab0ca4-c960-48e5-9e6b-979393a92f18`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:29:16,989::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:29:16,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667438 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:29:17,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:29:17,374::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00090599 s, 4.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:29:24,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`e30126ec-7638-44e5-8c69-05acde5bddd4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:29:24,673::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:29:24,674::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00090599', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667438', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:29:24,674::task::1191::Storage.TaskManager.Task::(prepare) Task=`e30126ec-7638-44e5-8c69-05acde5bddd4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00090599', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667438', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:29:24,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`e30126ec-7638-44e5-8c69-05acde5bddd4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:29:24,674::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:29:24,674::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:29:24,675::task::993::Storage.TaskManager.Task::(_decref) Task=`e30126ec-7638-44e5-8c69-05acde5bddd4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:29:27,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:29:27,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603177 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:29:27,375::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:29:27,383::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057049 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:29:37,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:29:37,031::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697378 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:29:37,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:29:37,391::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701825 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:29:39,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`63f4d3bf-180b-4c77-b49a-fc8d18a92a77`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:29:39,788::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:29:39,789::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701825', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697378', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:29:39,790::task::1191::Storage.TaskManager.Task::(prepare) Task=`63f4d3bf-180b-4c77-b49a-fc8d18a92a77`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701825', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697378', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:29:39,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`63f4d3bf-180b-4c77-b49a-fc8d18a92a77`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:29:39,790::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:29:39,790::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:29:39,790::task::993::Storage.TaskManager.Task::(_decref) Task=`63f4d3bf-180b-4c77-b49a-fc8d18a92a77`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:29:47,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:29:47,042::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649977 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:29:47,393::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:29:47,403::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000570852 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:29:54,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`1876a432-8639-4254-ae31-6e0c17a72a50`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:29:54,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:29:54,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570852', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649977', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:29:54,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`1876a432-8639-4254-ae31-6e0c17a72a50`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570852', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649977', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:29:54,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`1876a432-8639-4254-ae31-6e0c17a72a50`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:29:54,899::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:29:54,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:29:54,900::task::993::Storage.TaskManager.Task::(_decref) Task=`1876a432-8639-4254-ae31-6e0c17a72a50`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:29:57,045::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:29:57,053::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665796 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:29:57,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:29:57,413::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606209 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:30:07,068::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:30:07,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000822631 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:30:07,415::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:30:07,422::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568101 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:30:10,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`37ce6c20-d150-4cc7-a3df-8ba347d39061`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:30:10,007::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:30:10,007::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568101', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000822631', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:30:10,007::task::1191::Storage.TaskManager.Task::(prepare) Task=`37ce6c20-d150-4cc7-a3df-8ba347d39061`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568101', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000822631', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:30:10,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`37ce6c20-d150-4cc7-a3df-8ba347d39061`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:30:10,008::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:30:10,008::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:30:10,008::task::993::Storage.TaskManager.Task::(_decref) Task=`37ce6c20-d150-4cc7-a3df-8ba347d39061`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:30:17,081::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:30:17,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684878 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:30:17,423::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:30:17,431::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668206 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:30:25,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`09a66cce-a45e-4860-8f90-0b177ea33f80`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:30:25,122::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:30:25,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668206', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684878', 'lastCheck': '8.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:30:25,123::task::1191::Storage.TaskManager.Task::(prepare) Task=`09a66cce-a45e-4860-8f90-0b177ea33f80`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668206', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684878', 'lastCheck': '8.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:30:25,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`09a66cce-a45e-4860-8f90-0b177ea33f80`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:30:25,123::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:30:25,123::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:30:25,123::task::993::Storage.TaskManager.Task::(_decref) Task=`09a66cce-a45e-4860-8f90-0b177ea33f80`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:30:27,092::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:30:27,100::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675073 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:30:27,433::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:30:27,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614096 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:30:37,103::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:30:37,111::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000828996 s, 4.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:30:37,443::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:30:37,450::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693188 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:30:40,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9150c5b-e938-457a-b411-a61daeb1c75b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:30:40,238::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:30:40,238::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693188', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000828996', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:30:40,239::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9150c5b-e938-457a-b411-a61daeb1c75b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693188', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000828996', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:30:40,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9150c5b-e938-457a-b411-a61daeb1c75b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:30:40,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:30:40,239::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:30:40,239::task::993::Storage.TaskManager.Task::(_decref) Task=`d9150c5b-e938-457a-b411-a61daeb1c75b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:30:47,115::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:30:47,123::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715451 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:30:47,451::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:30:47,460::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000755451 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:30:55,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`46872e33-8839-4789-9d57-ee86b6740f4a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:30:55,357::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:30:55,358::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000755451', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715451', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:30:55,358::task::1191::Storage.TaskManager.Task::(prepare) Task=`46872e33-8839-4789-9d57-ee86b6740f4a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000755451', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715451', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:30:55,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`46872e33-8839-4789-9d57-ee86b6740f4a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:30:55,358::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:30:55,358::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:30:55,359::task::993::Storage.TaskManager.Task::(_decref) Task=`46872e33-8839-4789-9d57-ee86b6740f4a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:30:57,126::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:30:57,134::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704608 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:30:57,461::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:30:57,470::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692156 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:31:07,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:31:07,152::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00810037 s, 506 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:31:07,471::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:31:07,478::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636685 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:31:10,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`3949c1b3-dedb-4755-b817-38ce19110ac6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:31:10,535::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:31:10,535::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636685', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00810037', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:31:10,535::task::1191::Storage.TaskManager.Task::(prepare) Task=`3949c1b3-dedb-4755-b817-38ce19110ac6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636685', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00810037', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:31:10,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`3949c1b3-dedb-4755-b817-38ce19110ac6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:31:10,536::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:31:10,536::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:31:10,536::task::993::Storage.TaskManager.Task::(_decref) Task=`3949c1b3-dedb-4755-b817-38ce19110ac6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:31:17,156::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:31:17,163::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614549 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:31:17,480::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:31:17,488::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631418 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:31:25,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a55c62a-b9a8-4834-a1ac-6dd08a63ae2c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:31:25,642::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:31:25,643::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631418', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614549', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:31:25,643::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a55c62a-b9a8-4834-a1ac-6dd08a63ae2c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631418', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614549', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:31:25,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a55c62a-b9a8-4834-a1ac-6dd08a63ae2c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:31:25,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:31:25,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:31:25,644::task::993::Storage.TaskManager.Task::(_decref) Task=`6a55c62a-b9a8-4834-a1ac-6dd08a63ae2c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:31:27,166::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:31:27,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752553 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:31:27,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:31:27,498::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685347 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:31:37,178::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:31:37,186::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000723089 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:31:37,500::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:31:37,507::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000777624 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:31:40,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc2c4541-6753-4441-9f91-7473432af30e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:31:40,758::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:31:40,758::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777624', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723089', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:31:40,759::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc2c4541-6753-4441-9f91-7473432af30e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777624', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723089', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:31:40,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc2c4541-6753-4441-9f91-7473432af30e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:31:40,759::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:31:40,759::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:31:40,759::task::993::Storage.TaskManager.Task::(_decref) Task=`cc2c4541-6753-4441-9f91-7473432af30e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:31:47,189::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:31:47,198::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699693 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:31:47,508::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:31:47,515::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669489 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:31:55,870::task::595::Storage.TaskManager.Task::(_updateState) Task=`82da4363-c6af-4e8f-a7f1-7a51b5e2408f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:31:55,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:31:55,871::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669489', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699693', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:31:55,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`82da4363-c6af-4e8f-a7f1-7a51b5e2408f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669489', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699693', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:31:55,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`82da4363-c6af-4e8f-a7f1-7a51b5e2408f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:31:55,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:31:55,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:31:55,871::task::993::Storage.TaskManager.Task::(_decref) Task=`82da4363-c6af-4e8f-a7f1-7a51b5e2408f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:31:57,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:31:57,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679445 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:31:57,517::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:31:57,525::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679735 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:32:07,219::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:32:07,227::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752967 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:32:07,527::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:32:07,534::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649654 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:32:10,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`44ce4b05-712b-49b1-b68c-5d66378ed4fd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:32:10,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:32:10,982::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649654', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752967', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:32:10,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`44ce4b05-712b-49b1-b68c-5d66378ed4fd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649654', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752967', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:32:10,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`44ce4b05-712b-49b1-b68c-5d66378ed4fd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:32:10,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:32:10,982::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:32:10,983::task::993::Storage.TaskManager.Task::(_decref) Task=`44ce4b05-712b-49b1-b68c-5d66378ed4fd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:32:17,230::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:32:17,239::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000872854 s, 4.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:32:17,535::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:32:17,542::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683922 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:32:26,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`66cadcfc-9382-4c88-bc42-94d5ff373382`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:32:26,126::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:32:26,127::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683922', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000872854', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:32:26,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`66cadcfc-9382-4c88-bc42-94d5ff373382`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683922', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000872854', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:32:26,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`66cadcfc-9382-4c88-bc42-94d5ff373382`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:32:26,128::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:32:26,128::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:32:26,128::task::993::Storage.TaskManager.Task::(_decref) Task=`66cadcfc-9382-4c88-bc42-94d5ff373382`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:32:27,242::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:32:27,250::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066064 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:32:27,544::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:32:27,552::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624293 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:32:37,253::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:32:37,261::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740942 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:32:37,568::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:32:37,575::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065712 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:32:41,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae87bf9b-d624-449c-a9aa-1ad87f662bbe`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:32:41,242::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:32:41,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065712', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740942', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:32:41,242::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae87bf9b-d624-449c-a9aa-1ad87f662bbe`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065712', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740942', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:32:41,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae87bf9b-d624-449c-a9aa-1ad87f662bbe`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:32:41,243::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:32:41,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:32:41,243::task::993::Storage.TaskManager.Task::(_decref) Task=`ae87bf9b-d624-449c-a9aa-1ad87f662bbe`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:32:47,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:32:47,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637363 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:32:47,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:32:47,585::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807645 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:32:56,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`50a419fc-6670-4b89-b2be-f4e71a9e6174`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:32:56,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:32:56,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807645', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637363', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:32:56,369::task::1191::Storage.TaskManager.Task::(prepare) Task=`50a419fc-6670-4b89-b2be-f4e71a9e6174`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807645', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637363', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:32:56,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`50a419fc-6670-4b89-b2be-f4e71a9e6174`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:32:56,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:32:56,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:32:56,370::task::993::Storage.TaskManager.Task::(_decref) Task=`50a419fc-6670-4b89-b2be-f4e71a9e6174`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:32:57,275::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:32:57,283::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686388 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:32:57,587::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:32:57,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701608 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:33:07,286::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:07,294::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639476 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:07,601::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:07,608::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669987 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:33:11,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8c9a8ce-d876-43c2-ab21-cdb8bcbd37ec`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:33:11,498::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:33:11,499::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669987', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639476', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:33:11,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8c9a8ce-d876-43c2-ab21-cdb8bcbd37ec`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669987', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639476', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:33:11,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8c9a8ce-d876-43c2-ab21-cdb8bcbd37ec`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:33:11,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:33:11,499::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:33:11,499::task::993::Storage.TaskManager.Task::(_decref) Task=`d8c9a8ce-d876-43c2-ab21-cdb8bcbd37ec`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:33:17,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:17,306::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713001 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:17,609::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:17,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662887 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:33:26,629::task::595::Storage.TaskManager.Task::(_updateState) Task=`99ad50b1-8461-48d6-9a6d-214f83c1a4a7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:33:26,629::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:33:26,629::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662887', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713001', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:33:26,630::task::1191::Storage.TaskManager.Task::(prepare) Task=`99ad50b1-8461-48d6-9a6d-214f83c1a4a7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662887', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713001', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:33:26,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`99ad50b1-8461-48d6-9a6d-214f83c1a4a7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:33:26,630::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:33:26,630::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:33:26,630::task::993::Storage.TaskManager.Task::(_decref) Task=`99ad50b1-8461-48d6-9a6d-214f83c1a4a7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:33:27,309::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 15:33:27,310::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:33:27,310::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:27,318::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00069639 s, 2.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:33:27,318::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00069639 s, 2.9 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 15:33:27,318::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 15:33:27,318::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 15:33:27,318::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:33:27,319::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:33:27,319::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:33:27,319::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:33:27,319::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:33:27,320::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:33:27,320::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:27,583::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:33:27,604::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:33:27,604::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 15:33:27,606::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 15:33:27,606::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 15:33:27,606::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 15:33:27,606::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:27,618::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 15:33:27,619::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:33:27,619::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:27,627::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000592268 s, 3.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:27,628::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000592268 s, 3.5 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:33:27,628::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:33:27,628::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:33:27,628::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:33:27,628::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:33:27,629::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:33:27,629::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:33:27,629::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:33:27,629::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:33:27,630::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:27,774::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:33:27,774::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:27,784::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063034 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:27,825::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:27,825::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:33:27,826::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 15:33:27,827::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 15:33:27,827::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 15:33:27,827::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:33:27,827::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:27,997::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:27,998::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:28,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613124 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:33:37,788::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:37,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708785 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:38,008::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:38,015::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637655 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:33:41,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a0eb0f7-a645-47e7-a384-adc52713d0da`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:33:41,746::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:33:41,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637655', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708785', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:33:41,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a0eb0f7-a645-47e7-a384-adc52713d0da`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637655', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708785', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:33:41,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a0eb0f7-a645-47e7-a384-adc52713d0da`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:33:41,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:33:41,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:33:41,747::task::993::Storage.TaskManager.Task::(_decref) Task=`5a0eb0f7-a645-47e7-a384-adc52713d0da`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:33:47,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:47,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702953 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:48,016::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:48,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597731 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:33:56,861::task::595::Storage.TaskManager.Task::(_updateState) Task=`b72b85e2-1735-462c-8ad4-6ef7813fcb51`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:33:56,861::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:33:56,861::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597731', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702953', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:33:56,862::task::1191::Storage.TaskManager.Task::(prepare) Task=`b72b85e2-1735-462c-8ad4-6ef7813fcb51`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597731', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702953', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:33:56,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`b72b85e2-1735-462c-8ad4-6ef7813fcb51`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:33:56,862::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:33:56,862::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:33:56,862::task::993::Storage.TaskManager.Task::(_decref) Task=`b72b85e2-1735-462c-8ad4-6ef7813fcb51`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:33:57,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:33:57,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625683 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:33:58,026::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:33:58,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665887 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:34:07,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:34:07,842::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000551139 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:34:08,035::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:34:08,043::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580458 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:34:11,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`81136283-5c5e-44bd-9e4f-7017e5475796`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:34:11,975::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:34:11,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580458', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551139', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:34:11,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`81136283-5c5e-44bd-9e4f-7017e5475796`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580458', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551139', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:34:11,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`81136283-5c5e-44bd-9e4f-7017e5475796`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:34:11,975::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:34:11,976::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:34:11,976::task::993::Storage.TaskManager.Task::(_decref) Task=`81136283-5c5e-44bd-9e4f-7017e5475796`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:34:17,852::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:34:17,861::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710195 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:34:18,044::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:34:18,054::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673158 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:34:27,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7848628-17e7-4c33-a00d-afc4c2d2dd5d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:34:27,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:34:27,093::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673158', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710195', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:34:27,093::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7848628-17e7-4c33-a00d-afc4c2d2dd5d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673158', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710195', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:34:27,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7848628-17e7-4c33-a00d-afc4c2d2dd5d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:34:27,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:34:27,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:34:27,094::task::993::Storage.TaskManager.Task::(_decref) Task=`e7848628-17e7-4c33-a00d-afc4c2d2dd5d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:34:27,864::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:34:27,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737273 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:34:28,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:34:28,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065423 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:34:37,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:34:37,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00683734 s, 599 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:34:38,068::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:34:38,080::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654467 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:34:42,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f83969f-86d6-4548-8d56-e11f7ea5b0e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:34:42,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:34:42,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654467', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00683734', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:34:42,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f83969f-86d6-4548-8d56-e11f7ea5b0e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654467', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00683734', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:34:42,224::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f83969f-86d6-4548-8d56-e11f7ea5b0e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:34:42,224::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:34:42,224::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:34:42,224::task::993::Storage.TaskManager.Task::(_decref) Task=`4f83969f-86d6-4548-8d56-e11f7ea5b0e5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:34:47,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:34:47,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726648 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:34:48,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:34:48,090::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710456 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:34:57,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`503326fd-c089-4523-9c55-84777d7bd21a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:34:57,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:34:57,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710456', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726648', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:34:57,369::task::1191::Storage.TaskManager.Task::(prepare) Task=`503326fd-c089-4523-9c55-84777d7bd21a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710456', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726648', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:34:57,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`503326fd-c089-4523-9c55-84777d7bd21a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:34:57,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:34:57,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:34:57,370::task::993::Storage.TaskManager.Task::(_decref) Task=`503326fd-c089-4523-9c55-84777d7bd21a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:34:57,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:34:57,915::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771112 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:34:58,091::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:34:58,099::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063898 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:35:07,918::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:35:07,927::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764948 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:35:08,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:35:08,108::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620072 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:35:12,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`35ff08e5-1b14-4746-9bf7-b4d10c897aa1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:35:12,486::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:35:12,486::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620072', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764948', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:35:12,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`35ff08e5-1b14-4746-9bf7-b4d10c897aa1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620072', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764948', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:35:12,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`35ff08e5-1b14-4746-9bf7-b4d10c897aa1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:35:12,487::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:35:12,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:35:12,487::task::993::Storage.TaskManager.Task::(_decref) Task=`35ff08e5-1b14-4746-9bf7-b4d10c897aa1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:35:17,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:35:17,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718793 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:35:18,110::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:35:18,118::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065594 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:35:27,599::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e929948-d903-4b24-8396-ff59345101b7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:35:27,599::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:35:27,600::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065594', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718793', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:35:27,600::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e929948-d903-4b24-8396-ff59345101b7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065594', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718793', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:35:27,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e929948-d903-4b24-8396-ff59345101b7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:35:27,600::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:35:27,601::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:35:27,601::task::993::Storage.TaskManager.Task::(_decref) Task=`1e929948-d903-4b24-8396-ff59345101b7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:35:27,944::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:35:27,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000818499 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:35:28,120::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:35:28,130::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600375 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:35:37,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:35:37,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731525 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:35:38,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:35:38,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638946 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:35:42,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`b78728be-a48f-4159-b15e-9403542d0df9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:35:42,716::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:35:42,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638946', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731525', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:35:42,716::task::1191::Storage.TaskManager.Task::(prepare) Task=`b78728be-a48f-4159-b15e-9403542d0df9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638946', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731525', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:35:42,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`b78728be-a48f-4159-b15e-9403542d0df9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:35:42,717::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:35:42,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:35:42,717::task::993::Storage.TaskManager.Task::(_decref) Task=`b78728be-a48f-4159-b15e-9403542d0df9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:35:47,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:35:47,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679394 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:35:48,140::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:35:48,148::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598665 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:35:57,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`457037a2-1869-496e-aed2-f676922140a5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:35:57,820::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:35:57,820::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598665', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679394', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:35:57,821::task::1191::Storage.TaskManager.Task::(prepare) Task=`457037a2-1869-496e-aed2-f676922140a5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598665', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679394', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:35:57,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`457037a2-1869-496e-aed2-f676922140a5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:35:57,821::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:35:57,821::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:35:57,821::task::993::Storage.TaskManager.Task::(_decref) Task=`457037a2-1869-496e-aed2-f676922140a5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:35:57,981::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:35:57,989::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067398 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:35:58,150::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:35:58,158::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732011 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:36:07,993::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:36:08,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637452 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:36:08,159::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:36:08,167::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667353 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:36:12,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d2a98d9-78da-4813-b878-353f25f6e9b0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:36:12,934::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:36:12,935::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667353', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637452', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:36:12,935::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d2a98d9-78da-4813-b878-353f25f6e9b0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667353', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637452', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:36:12,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d2a98d9-78da-4813-b878-353f25f6e9b0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:36:12,935::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:36:12,935::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:36:12,935::task::993::Storage.TaskManager.Task::(_decref) Task=`2d2a98d9-78da-4813-b878-353f25f6e9b0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:36:18,005::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:36:18,013::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672632 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:36:18,168::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:36:18,176::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581665 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:36:28,016::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:36:28,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766162 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:36:28,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa58e9bd-2160-4794-9daf-ff0f5cc15220`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:36:28,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:36:28,058::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581665', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766162', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:36:28,058::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa58e9bd-2160-4794-9daf-ff0f5cc15220`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581665', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766162', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:36:28,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa58e9bd-2160-4794-9daf-ff0f5cc15220`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:36:28,059::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:36:28,059::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:36:28,059::task::993::Storage.TaskManager.Task::(_decref) Task=`aa58e9bd-2160-4794-9daf-ff0f5cc15220`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:36:28,178::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:36:28,186::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600786 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:36:38,027::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:36:38,036::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781784 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:36:38,188::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:36:38,195::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692724 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:36:43,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`5378e1c3-8497-4999-9855-9a71250dc3a5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:36:43,177::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:36:43,177::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692724', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781784', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:36:43,178::task::1191::Storage.TaskManager.Task::(prepare) Task=`5378e1c3-8497-4999-9855-9a71250dc3a5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692724', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781784', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:36:43,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`5378e1c3-8497-4999-9855-9a71250dc3a5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:36:43,178::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:36:43,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:36:43,178::task::993::Storage.TaskManager.Task::(_decref) Task=`5378e1c3-8497-4999-9855-9a71250dc3a5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:36:48,039::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:36:48,048::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714612 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:36:48,196::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:36:48,204::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749947 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:36:58,052::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:36:58,060::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597163 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:36:58,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:36:58,213::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540061 s, 7.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:36:58,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6976be6-1de8-4e1e-8151-a8148235b476`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:36:58,285::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:36:58,285::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540061', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597163', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:36:58,286::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6976be6-1de8-4e1e-8151-a8148235b476`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540061', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597163', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:36:58,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6976be6-1de8-4e1e-8151-a8148235b476`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:36:58,286::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:36:58,286::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:36:58,286::task::993::Storage.TaskManager.Task::(_decref) Task=`f6976be6-1de8-4e1e-8151-a8148235b476`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:37:08,063::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:37:08,072::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00171377 s, 2.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:37:08,215::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:37:08,222::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748825 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:37:13,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce600286-3d69-47b7-bc7a-3de7cf8df7ae`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:37:13,406::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:37:13,406::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748825', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171377', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:37:13,406::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce600286-3d69-47b7-bc7a-3de7cf8df7ae`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748825', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171377', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:37:13,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce600286-3d69-47b7-bc7a-3de7cf8df7ae`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:37:13,407::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:37:13,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:37:13,407::task::993::Storage.TaskManager.Task::(_decref) Task=`ce600286-3d69-47b7-bc7a-3de7cf8df7ae`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:37:18,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:37:18,084::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569177 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:37:18,224::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:37:18,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00309056 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:37:28,087::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:37:28,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072904 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:37:28,236::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:37:28,244::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064595 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:37:28,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`a784610c-4fcb-41b6-bcce-c8f450addb68`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:37:28,530::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:37:28,530::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064595', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072904', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:37:28,530::task::1191::Storage.TaskManager.Task::(prepare) Task=`a784610c-4fcb-41b6-bcce-c8f450addb68`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064595', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072904', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:37:28,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`a784610c-4fcb-41b6-bcce-c8f450addb68`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:37:28,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:37:28,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:37:28,531::task::993::Storage.TaskManager.Task::(_decref) Task=`a784610c-4fcb-41b6-bcce-c8f450addb68`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:37:38,098::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:37:38,107::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721076 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:37:38,246::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:37:38,253::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000584874 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:37:43,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2d6c002-5e85-4169-bdcb-f7e4be7185e0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:37:43,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:37:43,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584874', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721076', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:37:43,640::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2d6c002-5e85-4169-bdcb-f7e4be7185e0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584874', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721076', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:37:43,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2d6c002-5e85-4169-bdcb-f7e4be7185e0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:37:43,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:37:43,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:37:43,641::task::993::Storage.TaskManager.Task::(_decref) Task=`f2d6c002-5e85-4169-bdcb-f7e4be7185e0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:37:48,110::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:37:48,119::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071851 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:37:48,254::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:37:48,262::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756348 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:37:58,122::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:37:58,130::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000824206 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:37:58,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:37:58,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000769718 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:37:58,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`33ecca9b-fa5a-4089-90b3-2cc09f5dafb2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:37:58,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:37:58,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769718', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000824206', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:37:58,760::task::1191::Storage.TaskManager.Task::(prepare) Task=`33ecca9b-fa5a-4089-90b3-2cc09f5dafb2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769718', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000824206', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:37:58,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`33ecca9b-fa5a-4089-90b3-2cc09f5dafb2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:37:58,760::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:37:58,760::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:37:58,760::task::993::Storage.TaskManager.Task::(_decref) Task=`33ecca9b-fa5a-4089-90b3-2cc09f5dafb2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:38:08,133::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:38:08,142::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000793595 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:08,273::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:08,280::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712487 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:38:13,909::task::595::Storage.TaskManager.Task::(_updateState) Task=`271ad104-b668-4144-a9dd-db15e25a44f3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:38:13,910::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:38:13,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712487', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000793595', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:38:13,910::task::1191::Storage.TaskManager.Task::(prepare) Task=`271ad104-b668-4144-a9dd-db15e25a44f3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712487', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000793595', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:38:13,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`271ad104-b668-4144-a9dd-db15e25a44f3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:38:13,911::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:38:13,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:38:13,911::task::993::Storage.TaskManager.Task::(_decref) Task=`271ad104-b668-4144-a9dd-db15e25a44f3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:38:18,145::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:38:18,153::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698345 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:18,282::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:18,290::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800047 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:38:28,156::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 15:38:28,156::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:38:28,157::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:38:28,165::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000750174 s, 2.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:38:28,165::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000750174 s, 2.7 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 15:38:28,165::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 15:38:28,165::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 15:38:28,165::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:38:28,166::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:38:28,166::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:38:28,166::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:38:28,166::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:38:28,167::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:38:28,167::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:28,292::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 15:38:28,292::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:38:28,293::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:28,302::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000670186 s, 3.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:28,302::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000670186 s, 3.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:38:28,302::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:38:28,302::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:38:28,303::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:38:28,303::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 15:38:28,439::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:38:28,440::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:38:28,440::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 15:38:28,442::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:38:28,444::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 15:38:28,445::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 15:38:28,446::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 15:38:28,446::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:38:28,447::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:38:28,448::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:28,449::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:38:28,458::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:38:28,458::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 15:38:28,628::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:38:28,628::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:38:28,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000487858 s, 8.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:28,640::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:28,641::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:38:28,641::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 15:38:28,642::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 15:38:28,642::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 15:38:28,642::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:38:28,642::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:28,807::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:28,808::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:28,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068157 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:38:29,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`18ce1419-b793-4db4-82d3-c6cb865180b3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:38:29,025::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:38:29,025::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068157', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487858', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:38:29,025::task::1191::Storage.TaskManager.Task::(prepare) Task=`18ce1419-b793-4db4-82d3-c6cb865180b3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068157', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487858', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:38:29,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`18ce1419-b793-4db4-82d3-c6cb865180b3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:38:29,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:38:29,026::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:38:29,026::task::993::Storage.TaskManager.Task::(_decref) Task=`18ce1419-b793-4db4-82d3-c6cb865180b3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:38:38,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:38:38,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000777534 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:38,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:38,824::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000744941 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:38:44,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`79c5271e-7774-47cb-bccb-0a4f4c4d20f1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:38:44,132::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:38:44,132::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744941', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777534', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:38:44,132::task::1191::Storage.TaskManager.Task::(prepare) Task=`79c5271e-7774-47cb-bccb-0a4f4c4d20f1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744941', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777534', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:38:44,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`79c5271e-7774-47cb-bccb-0a4f4c4d20f1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:38:44,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:38:44,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:38:44,133::task::993::Storage.TaskManager.Task::(_decref) Task=`79c5271e-7774-47cb-bccb-0a4f4c4d20f1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:38:48,651::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:38:48,659::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105663 s, 3.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:48,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:48,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000985081 s, 4.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:38:58,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:38:58,671::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800583 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:38:58,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:38:58,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670709 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:38:59,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`006e1d09-be50-42a4-b485-e99a78c256fb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:38:59,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:38:59,258::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670709', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800583', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:38:59,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`006e1d09-be50-42a4-b485-e99a78c256fb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670709', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800583', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:38:59,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`006e1d09-be50-42a4-b485-e99a78c256fb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:38:59,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:38:59,259::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:38:59,259::task::993::Storage.TaskManager.Task::(_decref) Task=`006e1d09-be50-42a4-b485-e99a78c256fb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:39:08,674::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:39:08,682::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720488 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:39:08,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:39:08,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672061 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:39:14,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`cff6d410-2dc1-4aca-a28e-ec01fcbfb11c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:39:14,408::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:39:14,408::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672061', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720488', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:39:14,409::task::1191::Storage.TaskManager.Task::(prepare) Task=`cff6d410-2dc1-4aca-a28e-ec01fcbfb11c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672061', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720488', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:39:14,409::task::595::Storage.TaskManager.Task::(_updateState) Task=`cff6d410-2dc1-4aca-a28e-ec01fcbfb11c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:39:14,409::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:39:14,409::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:39:14,409::task::993::Storage.TaskManager.Task::(_decref) Task=`cff6d410-2dc1-4aca-a28e-ec01fcbfb11c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:39:18,685::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:39:18,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612442 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:39:18,854::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:39:18,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689879 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:39:28,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:39:28,704::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000934803 s, 4.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:39:28,864::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:39:28,872::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00076439 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:39:29,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ed6bdcf-9f28-4edc-a357-9be4385a1b42`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:39:29,520::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:39:29,520::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00076439', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000934803', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:39:29,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ed6bdcf-9f28-4edc-a357-9be4385a1b42`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00076439', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000934803', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:39:29,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ed6bdcf-9f28-4edc-a357-9be4385a1b42`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:39:29,520::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:39:29,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:39:29,521::task::993::Storage.TaskManager.Task::(_decref) Task=`8ed6bdcf-9f28-4edc-a357-9be4385a1b42`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:39:38,708::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:39:38,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731357 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:39:38,874::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:39:38,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741535 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:39:44,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`0959caca-84a2-4223-a05c-4f9fc1bfea93`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:39:44,627::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:39:44,628::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741535', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731357', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:39:44,628::task::1191::Storage.TaskManager.Task::(prepare) Task=`0959caca-84a2-4223-a05c-4f9fc1bfea93`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741535', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731357', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:39:44,628::task::595::Storage.TaskManager.Task::(_updateState) Task=`0959caca-84a2-4223-a05c-4f9fc1bfea93`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:39:44,628::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:39:44,628::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:39:44,628::task::993::Storage.TaskManager.Task::(_decref) Task=`0959caca-84a2-4223-a05c-4f9fc1bfea93`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:39:48,719::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:39:48,727::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666223 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:39:48,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:39:48,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000992436 s, 4.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:39:58,730::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:39:58,738::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000762529 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:39:58,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:39:58,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673421 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:39:59,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`5034a648-ffd1-4089-9ade-18499d44c583`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:39:59,739::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:39:59,739::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673421', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000762529', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:39:59,740::task::1191::Storage.TaskManager.Task::(prepare) Task=`5034a648-ffd1-4089-9ade-18499d44c583`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673421', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000762529', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:39:59,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`5034a648-ffd1-4089-9ade-18499d44c583`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:39:59,740::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:39:59,740::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:39:59,740::task::993::Storage.TaskManager.Task::(_decref) Task=`5034a648-ffd1-4089-9ade-18499d44c583`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:40:08,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:40:08,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007034 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:40:08,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:40:08,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000791532 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:40:14,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1fab436-3406-4ea6-8678-cd8ddd5c285d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:40:14,851::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:40:14,851::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791532', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007034', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:40:14,851::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1fab436-3406-4ea6-8678-cd8ddd5c285d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791532', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007034', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:40:14,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1fab436-3406-4ea6-8678-cd8ddd5c285d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:40:14,852::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:40:14,852::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:40:14,852::task::993::Storage.TaskManager.Task::(_decref) Task=`e1fab436-3406-4ea6-8678-cd8ddd5c285d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:40:18,754::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:40:18,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626811 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:40:18,912::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:40:18,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010908 s, 3.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:40:28,765::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:40:28,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751915 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:40:28,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:40:28,930::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604283 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:40:29,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`be557401-ad74-4597-99eb-b6459237c335`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:40:29,971::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:40:29,971::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604283', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751915', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:40:29,972::task::1191::Storage.TaskManager.Task::(prepare) Task=`be557401-ad74-4597-99eb-b6459237c335`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604283', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751915', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:40:29,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`be557401-ad74-4597-99eb-b6459237c335`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:40:29,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:40:29,972::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:40:29,972::task::993::Storage.TaskManager.Task::(_decref) Task=`be557401-ad74-4597-99eb-b6459237c335`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:40:38,776::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:40:38,785::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684967 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:40:38,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:40:38,938::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692143 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:40:45,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`231f0266-bf88-4093-8c0e-4065892a3877`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:40:45,082::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:40:45,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692143', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684967', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:40:45,083::task::1191::Storage.TaskManager.Task::(prepare) Task=`231f0266-bf88-4093-8c0e-4065892a3877`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692143', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684967', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:40:45,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`231f0266-bf88-4093-8c0e-4065892a3877`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:40:45,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:40:45,083::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:40:45,083::task::993::Storage.TaskManager.Task::(_decref) Task=`231f0266-bf88-4093-8c0e-4065892a3877`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:40:48,788::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:40:48,797::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686195 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:40:48,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:40:48,947::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705817 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:40:58,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:40:58,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610174 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:40:58,949::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:40:58,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636109 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:41:00,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bd3a123-f944-4bf9-aca1-22b51376efa0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:41:00,198::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:41:00,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636109', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610174', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:41:00,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`1bd3a123-f944-4bf9-aca1-22b51376efa0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636109', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610174', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:41:00,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bd3a123-f944-4bf9-aca1-22b51376efa0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:41:00,199::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:41:00,199::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:41:00,199::task::993::Storage.TaskManager.Task::(_decref) Task=`1bd3a123-f944-4bf9-aca1-22b51376efa0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:41:08,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:41:08,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614114 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:41:08,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:41:08,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667063 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:41:15,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bad11b4-7309-458c-9482-cd49ec63505e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:41:15,318::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:41:15,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667063', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614114', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:41:15,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`0bad11b4-7309-458c-9482-cd49ec63505e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667063', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614114', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:41:15,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bad11b4-7309-458c-9482-cd49ec63505e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:41:15,319::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:41:15,319::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:41:15,319::task::993::Storage.TaskManager.Task::(_decref) Task=`0bad11b4-7309-458c-9482-cd49ec63505e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:41:18,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:41:18,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682201 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:41:18,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:41:18,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655058 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:41:28,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:41:28,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697762 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:41:28,974::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:41:28,982::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612621 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:41:30,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`dee95f62-fe55-4fa1-906a-6893ada025ce`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:41:30,438::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:41:30,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612621', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697762', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:41:30,439::task::1191::Storage.TaskManager.Task::(prepare) Task=`dee95f62-fe55-4fa1-906a-6893ada025ce`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612621', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697762', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:41:30,439::task::595::Storage.TaskManager.Task::(_updateState) Task=`dee95f62-fe55-4fa1-906a-6893ada025ce`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:41:30,439::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:41:30,439::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:41:30,439::task::993::Storage.TaskManager.Task::(_decref) Task=`dee95f62-fe55-4fa1-906a-6893ada025ce`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:41:38,848::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:41:38,856::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689093 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:41:38,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:41:38,991::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638045 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:41:45,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`f867ef77-0289-46bf-ab43-ba2ae2e94647`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:41:45,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:41:45,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638045', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689093', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:41:45,555::task::1191::Storage.TaskManager.Task::(prepare) Task=`f867ef77-0289-46bf-ab43-ba2ae2e94647`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638045', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689093', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:41:45,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`f867ef77-0289-46bf-ab43-ba2ae2e94647`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:41:45,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:41:45,556::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:41:45,556::task::993::Storage.TaskManager.Task::(_decref) Task=`f867ef77-0289-46bf-ab43-ba2ae2e94647`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:41:48,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:41:48,867::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600365 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:41:48,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:41:49,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000815918 s, 5.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:41:58,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:41:58,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681004 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:41:59,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:41:59,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651916 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:42:00,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`32ad1644-2ddc-4913-b417-8cc80887bb9a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:42:00,667::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:42:00,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651916', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681004', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:42:00,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`32ad1644-2ddc-4913-b417-8cc80887bb9a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651916', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681004', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:42:00,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`32ad1644-2ddc-4913-b417-8cc80887bb9a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:42:00,668::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:42:00,668::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:42:00,668::task::993::Storage.TaskManager.Task::(_decref) Task=`32ad1644-2ddc-4913-b417-8cc80887bb9a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:42:08,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:42:08,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732939 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:42:09,012::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:42:09,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770966 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:42:15,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8fd10bf-cfaa-4229-98e2-828c1ca7bd79`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:42:15,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:42:15,777::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770966', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732939', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:42:15,777::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8fd10bf-cfaa-4229-98e2-828c1ca7bd79`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770966', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732939', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:42:15,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8fd10bf-cfaa-4229-98e2-828c1ca7bd79`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:42:15,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:42:15,777::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:42:15,777::task::993::Storage.TaskManager.Task::(_decref) Task=`f8fd10bf-cfaa-4229-98e2-828c1ca7bd79`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:42:18,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:42:18,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0403766 s, 101 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:42:19,021::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:42:19,028::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079203 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:42:28,945::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:42:28,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069222 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:42:29,030::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:42:29,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576557 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:42:30,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f3a85f0-0d15-4837-8248-c26fe3b15104`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:42:30,892::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:42:30,892::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576557', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069222', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:42:30,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f3a85f0-0d15-4837-8248-c26fe3b15104`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576557', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069222', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:42:30,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f3a85f0-0d15-4837-8248-c26fe3b15104`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:42:30,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:42:30,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:42:30,893::task::993::Storage.TaskManager.Task::(_decref) Task=`6f3a85f0-0d15-4837-8248-c26fe3b15104`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:42:38,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:42:38,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705702 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:42:39,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:42:39,047::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720153 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:42:46,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`a35fd959-7f87-4439-801a-4b425e4145e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:42:46,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:42:46,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720153', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705702', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:42:46,012::task::1191::Storage.TaskManager.Task::(prepare) Task=`a35fd959-7f87-4439-801a-4b425e4145e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720153', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705702', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:42:46,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`a35fd959-7f87-4439-801a-4b425e4145e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:42:46,012::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:42:46,012::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:42:46,013::task::993::Storage.TaskManager.Task::(_decref) Task=`a35fd959-7f87-4439-801a-4b425e4145e5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:42:48,968::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:42:48,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600707 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:42:49,048::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:42:49,056::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641783 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:42:58,993::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:42:59,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684755 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:42:59,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:42:59,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664787 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:43:01,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`17b97dc1-f3f0-4983-8997-61307dc8a812`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:43:01,119::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:43:01,120::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664787', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684755', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:43:01,120::task::1191::Storage.TaskManager.Task::(prepare) Task=`17b97dc1-f3f0-4983-8997-61307dc8a812`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664787', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684755', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:43:01,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`17b97dc1-f3f0-4983-8997-61307dc8a812`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:43:01,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:43:01,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:43:01,121::task::993::Storage.TaskManager.Task::(_decref) Task=`17b97dc1-f3f0-4983-8997-61307dc8a812`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:43:09,005::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:43:09,013::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694127 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:09,067::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:09,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061147 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:43:16,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb61fb6d-4036-4feb-ac06-ff38d2c46fd8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:43:16,242::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:43:16,243::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061147', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694127', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:43:16,243::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb61fb6d-4036-4feb-ac06-ff38d2c46fd8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061147', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694127', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:43:16,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb61fb6d-4036-4feb-ac06-ff38d2c46fd8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:43:16,243::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:43:16,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:43:16,243::task::993::Storage.TaskManager.Task::(_decref) Task=`fb61fb6d-4036-4feb-ac06-ff38d2c46fd8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:43:19,030::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:43:19,037::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640494 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:19,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:19,087::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00301905 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:43:29,040::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 15:43:29,041::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:43:29,041::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:43:29,049::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000633854 s, 3.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:43:29,049::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000633854 s, 3.2 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 15:43:29,049::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 15:43:29,049::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 15:43:29,050::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:43:29,050::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:43:29,050::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:43:29,050::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:43:29,051::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:43:29,051::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:43:29,051::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:29,088::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 15:43:29,089::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:43:29,089::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:29,098::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000592967 s, 3.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:29,098::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000592967 s, 3.5 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:43:29,099::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:43:29,099::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:43:29,099::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:43:29,099::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 15:43:29,330::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:43:29,330::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:43:29,332::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 15:43:29,332::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:43:29,335::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 15:43:29,337::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 15:43:29,338::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::DEBUG::2014-08-12 15:43:29,339::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 15:43:29,339::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 15:43:29,341::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:29,341::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:43:29,350::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:43:29,351::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 15:43:29,508::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:43:29,509::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:43:29,517::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000520085 s, 7.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:29,528::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:29,528::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:43:29,529::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 15:43:29,530::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 15:43:29,530::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 15:43:29,530::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:43:29,530::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:29,696::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:29,697::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:29,705::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000553912 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:43:31,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bef2c88-398e-476d-8fa4-6fed0b815e39`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:43:31,360::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:43:31,360::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553912', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520085', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:43:31,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`0bef2c88-398e-476d-8fa4-6fed0b815e39`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553912', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520085', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:43:31,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bef2c88-398e-476d-8fa4-6fed0b815e39`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:43:31,361::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:43:31,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:43:31,361::task::993::Storage.TaskManager.Task::(_decref) Task=`0bef2c88-398e-476d-8fa4-6fed0b815e39`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:43:39,521::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:43:39,528::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785524 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:39,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:39,714::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705974 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:43:46,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0e60861-72da-4118-88e2-7da9aafc5e17`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:43:46,502::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:43:46,503::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705974', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785524', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:43:46,503::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0e60861-72da-4118-88e2-7da9aafc5e17`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705974', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785524', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:43:46,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0e60861-72da-4118-88e2-7da9aafc5e17`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:43:46,503::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:43:46,503::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:43:46,504::task::993::Storage.TaskManager.Task::(_decref) Task=`a0e60861-72da-4118-88e2-7da9aafc5e17`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:43:49,532::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:43:49,539::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648814 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:49,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:49,723::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623698 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:43:59,543::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:43:59,552::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071815 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:43:59,725::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:43:59,733::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000811796 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:44:01,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a6c3045-4efd-4137-8873-ca148bed2f32`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:44:01,619::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:44:01,619::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811796', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071815', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:44:01,619::task::1191::Storage.TaskManager.Task::(prepare) Task=`4a6c3045-4efd-4137-8873-ca148bed2f32`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811796', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071815', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:44:01,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a6c3045-4efd-4137-8873-ca148bed2f32`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:44:01,620::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:44:01,620::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:44:01,620::task::993::Storage.TaskManager.Task::(_decref) Task=`4a6c3045-4efd-4137-8873-ca148bed2f32`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:44:09,555::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:44:09,563::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000744234 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:44:09,734::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:44:09,743::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000546181 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:44:16,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7eb0d7f-4cc4-4009-9325-16ed4257794f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:44:16,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:44:16,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546181', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744234', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:44:16,726::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7eb0d7f-4cc4-4009-9325-16ed4257794f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546181', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744234', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:44:16,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7eb0d7f-4cc4-4009-9325-16ed4257794f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:44:16,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:44:16,726::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:44:16,726::task::993::Storage.TaskManager.Task::(_decref) Task=`b7eb0d7f-4cc4-4009-9325-16ed4257794f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:44:19,567::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:44:19,575::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662525 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:44:19,744::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:44:19,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701113 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:44:29,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:44:29,587::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708669 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:44:29,754::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:44:29,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544976 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:44:31,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`8599c500-8c5f-4159-9dfa-fba485a491b9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:44:31,836::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:44:31,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544976', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708669', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:44:31,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`8599c500-8c5f-4159-9dfa-fba485a491b9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544976', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708669', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:44:31,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`8599c500-8c5f-4159-9dfa-fba485a491b9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:44:31,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:44:31,838::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:44:31,838::task::993::Storage.TaskManager.Task::(_decref) Task=`8599c500-8c5f-4159-9dfa-fba485a491b9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:44:39,590::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:44:39,598::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071892 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:44:39,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:44:39,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000823309 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:44:46,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`bebdebf9-5099-4ea6-88d1-3e72e38a8e82`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:44:46,954::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:44:46,954::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823309', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071892', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:44:46,955::task::1191::Storage.TaskManager.Task::(prepare) Task=`bebdebf9-5099-4ea6-88d1-3e72e38a8e82`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823309', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071892', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:44:46,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`bebdebf9-5099-4ea6-88d1-3e72e38a8e82`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:44:46,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:44:46,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:44:46,955::task::993::Storage.TaskManager.Task::(_decref) Task=`bebdebf9-5099-4ea6-88d1-3e72e38a8e82`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:44:49,602::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:44:49,609::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621728 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:44:49,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:44:49,781::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000507979 s, 8.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:44:59,613::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:44:59,621::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774181 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:44:59,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:44:59,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656047 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:45:02,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d30922a-357b-4284-9d8b-0c33e74956d4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:45:02,072::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:45:02,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656047', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774181', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:45:02,073::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d30922a-357b-4284-9d8b-0c33e74956d4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656047', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774181', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:45:02,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d30922a-357b-4284-9d8b-0c33e74956d4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:45:02,073::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:45:02,073::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:45:02,073::task::993::Storage.TaskManager.Task::(_decref) Task=`0d30922a-357b-4284-9d8b-0c33e74956d4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:45:09,624::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:45:09,633::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658674 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:45:09,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:45:09,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617386 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:45:17,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fac5206-9d8a-45a5-afa1-b71da6d2792e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:45:17,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:45:17,179::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617386', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658674', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:45:17,179::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fac5206-9d8a-45a5-afa1-b71da6d2792e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617386', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658674', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:45:17,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fac5206-9d8a-45a5-afa1-b71da6d2792e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:45:17,179::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:45:17,180::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:45:17,180::task::993::Storage.TaskManager.Task::(_decref) Task=`9fac5206-9d8a-45a5-afa1-b71da6d2792e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:45:19,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:45:19,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650921 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:45:19,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:45:19,809::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700183 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:45:29,650::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:45:29,660::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681981 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:45:29,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:45:29,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062777 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:45:32,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`c13af9d4-025e-47c7-baf1-8473692c9224`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:45:32,303::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:45:32,303::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062777', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681981', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:45:32,303::task::1191::Storage.TaskManager.Task::(prepare) Task=`c13af9d4-025e-47c7-baf1-8473692c9224`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062777', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681981', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:45:32,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`c13af9d4-025e-47c7-baf1-8473692c9224`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:45:32,304::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:45:32,304::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:45:32,304::task::993::Storage.TaskManager.Task::(_decref) Task=`c13af9d4-025e-47c7-baf1-8473692c9224`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:45:39,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:45:39,683::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611097 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:45:39,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:45:39,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698318 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:45:47,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`094f626d-44f8-4a45-8610-a922807aa0f2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:45:47,418::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:45:47,419::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698318', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611097', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:45:47,419::task::1191::Storage.TaskManager.Task::(prepare) Task=`094f626d-44f8-4a45-8610-a922807aa0f2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698318', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611097', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:45:47,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`094f626d-44f8-4a45-8610-a922807aa0f2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:45:47,419::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:45:47,419::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:45:47,419::task::993::Storage.TaskManager.Task::(_decref) Task=`094f626d-44f8-4a45-8610-a922807aa0f2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:45:49,686::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:45:49,695::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588579 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:45:49,833::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:45:49,842::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000964836 s, 4.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:45:59,698::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:45:59,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738836 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:45:59,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:45:59,852::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643284 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:46:02,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1507bfb-d3ce-4f89-bac8-4349d55c7406`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:46:02,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:46:02,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643284', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738836', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:46:02,540::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1507bfb-d3ce-4f89-bac8-4349d55c7406`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643284', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738836', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:46:02,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1507bfb-d3ce-4f89-bac8-4349d55c7406`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:46:02,540::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:46:02,541::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:46:02,541::task::993::Storage.TaskManager.Task::(_decref) Task=`b1507bfb-d3ce-4f89-bac8-4349d55c7406`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:46:09,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:46:09,719::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071302 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:46:09,854::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:46:09,861::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710262 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:46:17,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d2514d9-0a6e-430b-9482-a863348e4687`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:46:17,661::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:46:17,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710262', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071302', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:46:17,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d2514d9-0a6e-430b-9482-a863348e4687`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710262', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071302', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:46:17,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d2514d9-0a6e-430b-9482-a863348e4687`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:46:17,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:46:17,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:46:17,662::task::993::Storage.TaskManager.Task::(_decref) Task=`6d2514d9-0a6e-430b-9482-a863348e4687`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:46:19,722::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:46:19,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656683 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:46:19,863::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:46:19,872::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000776627 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:46:29,733::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:46:29,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737764 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:46:29,877::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:46:29,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615254 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:46:32,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`526ffd53-47fb-49ed-80d5-bf990db4382e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:46:32,767::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:46:32,767::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615254', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737764', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:46:32,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`526ffd53-47fb-49ed-80d5-bf990db4382e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615254', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737764', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:46:32,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`526ffd53-47fb-49ed-80d5-bf990db4382e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:46:32,768::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:46:32,768::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:46:32,768::task::993::Storage.TaskManager.Task::(_decref) Task=`526ffd53-47fb-49ed-80d5-bf990db4382e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:46:39,744::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:46:39,753::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678984 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:46:39,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:46:39,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659349 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:46:47,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`f184ba19-4492-449f-9ccb-2a37b6fba059`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:46:47,871::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:46:47,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659349', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678984', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:46:47,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`f184ba19-4492-449f-9ccb-2a37b6fba059`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659349', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678984', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:46:47,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`f184ba19-4492-449f-9ccb-2a37b6fba059`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:46:47,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:46:47,872::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:46:47,872::task::993::Storage.TaskManager.Task::(_decref) Task=`f184ba19-4492-449f-9ccb-2a37b6fba059`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:46:49,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:46:49,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610616 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:46:49,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:46:49,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581362 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:46:59,767::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:46:59,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757869 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:46:59,904::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:46:59,912::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682033 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:47:02,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bfca4c6-2f7a-4428-9c57-c1179a9c2171`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:47:02,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:47:02,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682033', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757869', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:47:02,992::task::1191::Storage.TaskManager.Task::(prepare) Task=`9bfca4c6-2f7a-4428-9c57-c1179a9c2171`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682033', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757869', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:47:02,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bfca4c6-2f7a-4428-9c57-c1179a9c2171`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:47:02,993::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:47:02,993::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:47:02,993::task::993::Storage.TaskManager.Task::(_decref) Task=`9bfca4c6-2f7a-4428-9c57-c1179a9c2171`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:47:09,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:47:09,788::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708729 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:47:09,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:47:09,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585502 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:47:18,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`789641db-008e-4dc8-8d8c-7050b7f34f7e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:47:18,122::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:47:18,123::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585502', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708729', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:47:18,123::task::1191::Storage.TaskManager.Task::(prepare) Task=`789641db-008e-4dc8-8d8c-7050b7f34f7e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585502', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708729', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:47:18,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`789641db-008e-4dc8-8d8c-7050b7f34f7e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:47:18,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:47:18,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:47:18,125::task::993::Storage.TaskManager.Task::(_decref) Task=`789641db-008e-4dc8-8d8c-7050b7f34f7e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:47:19,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:47:19,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694846 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:47:19,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:47:19,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704927 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:47:29,802::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:47:29,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720381 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:47:29,930::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:47:29,938::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057903 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:47:33,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ad20c88-b878-48b9-ad38-c14ed1c06bb8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:47:33,238::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:47:33,239::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057903', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720381', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:47:33,239::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ad20c88-b878-48b9-ad38-c14ed1c06bb8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057903', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720381', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:47:33,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ad20c88-b878-48b9-ad38-c14ed1c06bb8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:47:33,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:47:33,239::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:47:33,239::task::993::Storage.TaskManager.Task::(_decref) Task=`7ad20c88-b878-48b9-ad38-c14ed1c06bb8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:47:39,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:47:39,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000527868 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:47:39,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:47:39,949::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645812 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:47:48,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`355421f7-da8e-48ba-96f5-c0ec645488e0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:47:48,370::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:47:48,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645812', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527868', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:47:48,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`355421f7-da8e-48ba-96f5-c0ec645488e0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645812', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527868', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:47:48,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`355421f7-da8e-48ba-96f5-c0ec645488e0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:47:48,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:47:48,371::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:47:48,371::task::993::Storage.TaskManager.Task::(_decref) Task=`355421f7-da8e-48ba-96f5-c0ec645488e0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:47:49,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:47:49,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000561578 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:47:49,951::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:47:49,959::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707235 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:47:59,848::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:47:59,856::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697183 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:47:59,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:47:59,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656649 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:48:03,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5fcd741-3517-40af-a6b1-76bdaffeb603`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:48:03,484::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:48:03,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656649', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697183', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:48:03,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5fcd741-3517-40af-a6b1-76bdaffeb603`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656649', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697183', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:48:03,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5fcd741-3517-40af-a6b1-76bdaffeb603`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:48:03,485::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:48:03,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:48:03,485::task::993::Storage.TaskManager.Task::(_decref) Task=`a5fcd741-3517-40af-a6b1-76bdaffeb603`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:48:09,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:48:09,868::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679826 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:48:09,970::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:09,977::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626864 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:48:18,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e852ab3-67ce-4bdb-b4a9-354bdcc31651`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:48:18,607::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:48:18,607::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626864', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679826', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:48:18,607::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e852ab3-67ce-4bdb-b4a9-354bdcc31651`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626864', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679826', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:48:18,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e852ab3-67ce-4bdb-b4a9-354bdcc31651`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:48:18,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:48:18,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:48:18,608::task::993::Storage.TaskManager.Task::(_decref) Task=`6e852ab3-67ce-4bdb-b4a9-354bdcc31651`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:48:19,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:48:19,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625233 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:48:19,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:19,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00052717 s, 7.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:48:29,882::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 15:48:29,883::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:48:29,883::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:48:29,892::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000627941 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:48:29,892::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000627941 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 15:48:29,893::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 15:48:29,893::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 15:48:29,893::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:48:29,893::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:48:29,894::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:48:29,894::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:48:29,894::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:48:29,894::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:48:29,895::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:29,989::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 15:48:29,989::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:48:29,990::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:29,998::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00053358 s, 3.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:48:29,999::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00053358 s, 3.8 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:48:29,999::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:48:29,999::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:48:29,999::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:48:30,000::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 15:48:30,139::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:48:30,139::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:48:30,140::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 15:48:30,141::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:48:30,144::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 15:48:30,144::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 15:48:30,145::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 15:48:30,146::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:48:30,146::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:48:30,148::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:30,149::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:48:30,157::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:48:30,157::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 15:48:30,316::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:48:30,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:48:30,325::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663829 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:48:30,335::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:48:30,336::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:48:30,336::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 15:48:30,337::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 15:48:30,337::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 15:48:30,337::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:48:30,338::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:30,503::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:48:30,504::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:30,511::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000502868 s, 8.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:48:33,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf771b2c-8913-4bc8-ac73-e823ef08d1b1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:48:33,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:48:33,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502868', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663829', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:48:33,719::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf771b2c-8913-4bc8-ac73-e823ef08d1b1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502868', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663829', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:48:33,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf771b2c-8913-4bc8-ac73-e823ef08d1b1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:48:33,719::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:48:33,719::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:48:33,719::task::993::Storage.TaskManager.Task::(_decref) Task=`cf771b2c-8913-4bc8-ac73-e823ef08d1b1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:48:40,329::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:48:40,338::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000778918 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:48:40,513::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:40,520::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000856431 s, 4.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:48:48,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`98915735-4b82-4a5d-a84e-da1176823846`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:48:48,839::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:48:48,840::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000856431', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778918', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:48:48,840::task::1191::Storage.TaskManager.Task::(prepare) Task=`98915735-4b82-4a5d-a84e-da1176823846`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000856431', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778918', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:48:48,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`98915735-4b82-4a5d-a84e-da1176823846`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:48:48,840::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:48:48,840::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:48:48,840::task::993::Storage.TaskManager.Task::(_decref) Task=`98915735-4b82-4a5d-a84e-da1176823846`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:48:50,341::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:48:50,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000541833 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:48:50,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:48:50,531::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631764 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:49:00,352::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:49:00,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110053 s, 3.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:49:00,533::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:49:00,541::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623619 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:49:03,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a33ce0d-a4d5-4313-bd54-f4d2f243a4f4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:49:03,956::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:49:03,956::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623619', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110053', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:49:03,956::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a33ce0d-a4d5-4313-bd54-f4d2f243a4f4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623619', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110053', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:49:03,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a33ce0d-a4d5-4313-bd54-f4d2f243a4f4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:49:03,957::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:49:03,957::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:49:03,957::task::993::Storage.TaskManager.Task::(_decref) Task=`1a33ce0d-a4d5-4313-bd54-f4d2f243a4f4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:49:10,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:49:10,372::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706278 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:49:10,543::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:49:10,550::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619582 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:49:19,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd3ac7b0-8431-4eca-be74-0162a7f38040`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:49:19,100::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:49:19,100::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619582', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706278', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:49:19,101::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd3ac7b0-8431-4eca-be74-0162a7f38040`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619582', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706278', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:49:19,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd3ac7b0-8431-4eca-be74-0162a7f38040`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:49:19,101::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:49:19,101::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:49:19,101::task::993::Storage.TaskManager.Task::(_decref) Task=`fd3ac7b0-8431-4eca-be74-0162a7f38040`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:49:20,375::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:49:20,383::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695192 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:49:20,551::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:49:20,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587198 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:49:30,386::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:49:30,394::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728288 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:49:30,562::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:49:30,570::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748083 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:49:34,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d8426f0-1be3-4f53-b2f9-a8767d1ec856`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:49:34,212::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:49:34,212::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748083', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728288', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:49:34,212::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d8426f0-1be3-4f53-b2f9-a8767d1ec856`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748083', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728288', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:49:34,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d8426f0-1be3-4f53-b2f9-a8767d1ec856`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:49:34,213::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:49:34,213::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:49:34,213::task::993::Storage.TaskManager.Task::(_decref) Task=`9d8426f0-1be3-4f53-b2f9-a8767d1ec856`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:49:40,398::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:49:40,406::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711996 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:49:40,571::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:49:40,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740427 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:49:49,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`b20bdb63-7eb0-44f0-a428-0ff49e790356`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:49:49,339::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:49:49,339::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740427', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711996', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:49:49,339::task::1191::Storage.TaskManager.Task::(prepare) Task=`b20bdb63-7eb0-44f0-a428-0ff49e790356`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740427', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711996', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:49:49,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`b20bdb63-7eb0-44f0-a428-0ff49e790356`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:49:49,339::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:49:49,340::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:49:49,340::task::993::Storage.TaskManager.Task::(_decref) Task=`b20bdb63-7eb0-44f0-a428-0ff49e790356`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:49:50,409::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:49:50,416::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00052574 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:49:50,580::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:49:50,588::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756534 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:50:00,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:50:00,428::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790768 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:50:00,590::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:50:00,598::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00055431 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:50:04,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed819c6-64da-4e78-8385-7c1de28c0c07`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:50:04,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:50:04,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055431', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790768', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:50:04,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ed819c6-64da-4e78-8385-7c1de28c0c07`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055431', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790768', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:50:04,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed819c6-64da-4e78-8385-7c1de28c0c07`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:50:04,459::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:50:04,459::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:50:04,459::task::993::Storage.TaskManager.Task::(_decref) Task=`9ed819c6-64da-4e78-8385-7c1de28c0c07`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:50:10,431::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:50:10,439::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712585 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:50:10,619::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:50:10,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652828 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:50:19,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdd24114-ed35-40fe-ac14-5e56bff708bd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:50:19,581::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:50:19,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652828', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712585', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:50:19,581::task::1191::Storage.TaskManager.Task::(prepare) Task=`cdd24114-ed35-40fe-ac14-5e56bff708bd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652828', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712585', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:50:19,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdd24114-ed35-40fe-ac14-5e56bff708bd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:50:19,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:50:19,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:50:19,582::task::993::Storage.TaskManager.Task::(_decref) Task=`cdd24114-ed35-40fe-ac14-5e56bff708bd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:50:20,443::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:50:20,451::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586199 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:50:20,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:50:20,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000495951 s, 8.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:50:30,454::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:50:30,462::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714252 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:50:30,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:50:30,645::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628226 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:50:34,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9e95344-ae9d-4373-9d82-6eec2ec16770`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:50:34,695::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:50:34,696::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628226', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714252', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:50:34,696::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9e95344-ae9d-4373-9d82-6eec2ec16770`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628226', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714252', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:50:34,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9e95344-ae9d-4373-9d82-6eec2ec16770`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:50:34,696::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:50:34,696::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:50:34,697::task::993::Storage.TaskManager.Task::(_decref) Task=`d9e95344-ae9d-4373-9d82-6eec2ec16770`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:50:40,465::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:50:40,473::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000736881 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:50:40,647::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:50:40,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589528 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:50:49,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe17d545-5f75-48b4-9ad2-c0e379c37efd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:50:49,807::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:50:49,807::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589528', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000736881', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:50:49,807::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe17d545-5f75-48b4-9ad2-c0e379c37efd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589528', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000736881', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:50:49,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe17d545-5f75-48b4-9ad2-c0e379c37efd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:50:49,808::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:50:49,808::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:50:49,808::task::993::Storage.TaskManager.Task::(_decref) Task=`fe17d545-5f75-48b4-9ad2-c0e379c37efd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:50:50,476::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:50:50,484::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580678 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:50:50,655::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:50:50,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060781 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:51:00,487::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:51:00,496::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813117 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:51:00,665::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:51:00,673::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617474 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:51:04,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`279b200e-5517-465d-aeef-0639d4f100d9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:51:04,915::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:51:04,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617474', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813117', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:51:04,916::task::1191::Storage.TaskManager.Task::(prepare) Task=`279b200e-5517-465d-aeef-0639d4f100d9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617474', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813117', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:51:04,916::task::595::Storage.TaskManager.Task::(_updateState) Task=`279b200e-5517-465d-aeef-0639d4f100d9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:51:04,916::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:51:04,916::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:51:04,916::task::993::Storage.TaskManager.Task::(_decref) Task=`279b200e-5517-465d-aeef-0639d4f100d9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:51:10,507::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:51:10,516::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641378 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:51:10,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:51:10,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788408 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:51:20,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ff196a5-35b9-44ff-a5df-150a66a18865`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:51:20,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:51:20,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788408', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641378', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:51:20,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ff196a5-35b9-44ff-a5df-150a66a18865`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788408', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641378', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:51:20,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ff196a5-35b9-44ff-a5df-150a66a18865`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:51:20,024::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:51:20,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:51:20,024::task::993::Storage.TaskManager.Task::(_decref) Task=`8ff196a5-35b9-44ff-a5df-150a66a18865`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:51:20,519::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:51:20,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603351 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:51:20,685::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:51:20,694::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656926 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:51:30,530::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:51:30,538::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664265 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:51:30,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:51:30,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686211 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:51:35,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`232201ee-03ac-413f-ae14-ef419fc6d471`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:51:35,135::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:51:35,135::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686211', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664265', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:51:35,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`232201ee-03ac-413f-ae14-ef419fc6d471`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686211', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664265', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:51:35,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`232201ee-03ac-413f-ae14-ef419fc6d471`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:51:35,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:51:35,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:51:35,136::task::993::Storage.TaskManager.Task::(_decref) Task=`232201ee-03ac-413f-ae14-ef419fc6d471`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:51:40,552::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:51:40,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746102 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:51:40,704::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:51:40,711::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632182 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:51:50,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`54f0df0b-4475-440e-985c-d2fe6c1e2554`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:51:50,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:51:50,243::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632182', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746102', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:51:50,243::task::1191::Storage.TaskManager.Task::(prepare) Task=`54f0df0b-4475-440e-985c-d2fe6c1e2554`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632182', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746102', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:51:50,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`54f0df0b-4475-440e-985c-d2fe6c1e2554`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:51:50,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:51:50,244::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:51:50,244::task::993::Storage.TaskManager.Task::(_decref) Task=`54f0df0b-4475-440e-985c-d2fe6c1e2554`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:51:50,564::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:51:50,571::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583193 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:51:50,712::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:51:50,720::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722289 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:52:00,575::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:52:00,583::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000789153 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:52:00,722::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:52:00,730::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637379 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:52:05,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b19f268-376f-44cf-9017-06e80e729e3c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:52:05,367::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:52:05,368::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637379', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789153', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:52:05,368::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b19f268-376f-44cf-9017-06e80e729e3c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637379', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789153', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:52:05,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b19f268-376f-44cf-9017-06e80e729e3c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:52:05,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:52:05,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:52:05,368::task::993::Storage.TaskManager.Task::(_decref) Task=`1b19f268-376f-44cf-9017-06e80e729e3c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:52:10,603::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:52:10,611::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785087 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:52:10,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:52:10,739::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633599 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:52:20,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f5afa30-50c6-46c7-a8ce-04bf56d84177`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:52:20,510::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:52:20,510::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633599', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785087', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:52:20,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f5afa30-50c6-46c7-a8ce-04bf56d84177`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633599', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785087', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:52:20,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f5afa30-50c6-46c7-a8ce-04bf56d84177`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:52:20,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:52:20,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:52:20,511::task::993::Storage.TaskManager.Task::(_decref) Task=`0f5afa30-50c6-46c7-a8ce-04bf56d84177`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:52:20,621::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:52:20,628::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651222 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:52:20,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:52:20,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581959 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:52:30,632::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:52:30,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655713 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:52:30,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:52:30,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618146 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:52:35,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1e3bebe-1be0-44bc-99af-4e72099fa72c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:52:35,657::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:52:35,657::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618146', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655713', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:52:35,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1e3bebe-1be0-44bc-99af-4e72099fa72c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618146', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655713', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:52:35,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1e3bebe-1be0-44bc-99af-4e72099fa72c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:52:35,658::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:52:35,658::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:52:35,658::task::993::Storage.TaskManager.Task::(_decref) Task=`c1e3bebe-1be0-44bc-99af-4e72099fa72c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:52:40,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:52:40,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000767005 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:52:40,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:52:40,778::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618026 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:52:50,655::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:52:50,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614437 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:52:50,779::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:52:50,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711484 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:52:50,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`463af56a-cc58-44f1-bb15-23d7aa15322a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:52:50,792::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:52:50,793::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711484', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614437', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:52:50,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`463af56a-cc58-44f1-bb15-23d7aa15322a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711484', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614437', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:52:50,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`463af56a-cc58-44f1-bb15-23d7aa15322a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:52:50,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:52:50,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:52:50,793::task::993::Storage.TaskManager.Task::(_decref) Task=`463af56a-cc58-44f1-bb15-23d7aa15322a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:53:00,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:53:00,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739947 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:53:00,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:00,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631127 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:53:05,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c34828f-2a4d-4d38-bf24-cb70f9cd94dc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:53:05,920::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:53:05,920::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631127', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739947', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:53:05,920::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c34828f-2a4d-4d38-bf24-cb70f9cd94dc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631127', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739947', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:53:05,920::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c34828f-2a4d-4d38-bf24-cb70f9cd94dc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:53:05,920::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:53:05,921::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:53:05,921::task::993::Storage.TaskManager.Task::(_decref) Task=`4c34828f-2a4d-4d38-bf24-cb70f9cd94dc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:53:10,678::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:53:10,686::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814066 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:53:10,802::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:10,809::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610464 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:53:20,690::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:53:20,698::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632342 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:53:20,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:20,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642349 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:53:21,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`47f51b7c-e7f5-4f31-b79d-9ec7eefd1975`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:53:21,032::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:53:21,032::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642349', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632342', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:53:21,032::task::1191::Storage.TaskManager.Task::(prepare) Task=`47f51b7c-e7f5-4f31-b79d-9ec7eefd1975`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642349', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632342', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:53:21,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`47f51b7c-e7f5-4f31-b79d-9ec7eefd1975`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:53:21,033::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:53:21,033::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:53:21,033::task::993::Storage.TaskManager.Task::(_decref) Task=`47f51b7c-e7f5-4f31-b79d-9ec7eefd1975`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:53:30,701::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 15:53:30,701::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:53:30,701::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:53:30,709::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000628978 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:53:30,709::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000628978 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 15:53:30,709::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 15:53:30,710::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 15:53:30,710::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:53:30,710::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:53:30,710::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:53:30,711::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:53:30,711::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:53:30,711::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:53:30,711::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:30,820::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 15:53:30,820::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:53:30,821::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:30,829::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00060518 s, 3.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:53:30,830::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00060518 s, 3.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:53:30,830::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:53:30,830::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:53:30,830::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:53:30,831::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 15:53:30,948::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:53:30,949::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:53:30,949::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 15:53:30,950::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:53:30,953::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 15:53:30,954::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 15:53:30,955::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 15:53:30,955::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:53:30,956::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:53:30,957::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:30,958::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:53:30,967::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:53:30,967::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 15:53:31,132::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:53:31,133::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:53:31,141::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000534272 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:53:31,146::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:53:31,147::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:53:31,147::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 15:53:31,148::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 15:53:31,148::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 15:53:31,148::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:53:31,148::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:31,315::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:53:31,316::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:31,323::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562519 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:53:36,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`47e30ef4-541d-485a-8ba2-f272c90cb11a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:53:36,148::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:53:36,167::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562519', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534272', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:53:36,167::task::1191::Storage.TaskManager.Task::(prepare) Task=`47e30ef4-541d-485a-8ba2-f272c90cb11a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562519', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534272', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:53:36,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`47e30ef4-541d-485a-8ba2-f272c90cb11a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:53:36,167::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:53:36,168::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:53:36,168::task::993::Storage.TaskManager.Task::(_decref) Task=`47e30ef4-541d-485a-8ba2-f272c90cb11a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:53:41,145::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:53:41,153::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000775713 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:53:41,325::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:41,332::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604064 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:53:51,156::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:53:51,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674026 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:53:51,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1fdab95-15c7-45ea-ad85-114f585e5fd2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:53:51,278::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:53:51,279::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604064', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674026', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:53:51,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1fdab95-15c7-45ea-ad85-114f585e5fd2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604064', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674026', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:53:51,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1fdab95-15c7-45ea-ad85-114f585e5fd2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:53:51,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:53:51,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:53:51,279::task::993::Storage.TaskManager.Task::(_decref) Task=`f1fdab95-15c7-45ea-ad85-114f585e5fd2`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 15:53:51,333::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:53:51,342::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734084 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:54:01,169::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:54:01,176::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760574 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:54:01,343::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:54:01,351::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064213 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:54:06,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`73244980-1f7c-4830-a521-2df3f608d5cf`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:54:06,388::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:54:06,388::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064213', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760574', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:54:06,388::task::1191::Storage.TaskManager.Task::(prepare) Task=`73244980-1f7c-4830-a521-2df3f608d5cf`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064213', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760574', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:54:06,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`73244980-1f7c-4830-a521-2df3f608d5cf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:54:06,389::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:54:06,389::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:54:06,389::task::993::Storage.TaskManager.Task::(_decref) Task=`73244980-1f7c-4830-a521-2df3f608d5cf`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:54:11,179::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:54:11,187::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713509 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:54:11,353::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:54:11,360::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586443 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:54:21,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:54:21,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000778109 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:54:21,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:54:21,368::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632052 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:54:21,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`63070ae9-0911-40d5-aae1-c7bb0e819a24`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:54:21,494::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:54:21,494::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632052', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778109', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:54:21,494::task::1191::Storage.TaskManager.Task::(prepare) Task=`63070ae9-0911-40d5-aae1-c7bb0e819a24`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632052', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778109', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:54:21,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`63070ae9-0911-40d5-aae1-c7bb0e819a24`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:54:21,495::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:54:21,495::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:54:21,495::task::993::Storage.TaskManager.Task::(_decref) Task=`63070ae9-0911-40d5-aae1-c7bb0e819a24`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:54:31,214::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:54:31,222::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071005 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:54:31,370::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:54:31,379::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705876 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:54:36,613::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ec35e59-53a4-4bf8-a018-259d17b145fc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:54:36,614::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:54:36,628::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705876', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071005', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:54:36,628::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ec35e59-53a4-4bf8-a018-259d17b145fc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705876', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071005', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:54:36,629::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ec35e59-53a4-4bf8-a018-259d17b145fc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:54:36,629::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:54:36,629::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:54:36,629::task::993::Storage.TaskManager.Task::(_decref) Task=`0ec35e59-53a4-4bf8-a018-259d17b145fc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:54:41,225::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:54:41,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713025 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:54:41,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:54:41,404::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669748 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:54:51,236::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:54:51,245::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693074 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:54:51,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:54:51,412::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662673 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:54:51,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`16e71cd6-32b9-480f-9ec0-ebb37afe0cab`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:54:51,740::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:54:51,740::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662673', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693074', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:54:51,740::task::1191::Storage.TaskManager.Task::(prepare) Task=`16e71cd6-32b9-480f-9ec0-ebb37afe0cab`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662673', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693074', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:54:51,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`16e71cd6-32b9-480f-9ec0-ebb37afe0cab`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:54:51,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:54:51,741::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:54:51,741::task::993::Storage.TaskManager.Task::(_decref) Task=`16e71cd6-32b9-480f-9ec0-ebb37afe0cab`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:55:01,248::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:55:01,257::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00154057 s, 2.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:55:01,414::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:55:01,422::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658074 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:55:06,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d921b59-9af5-4e76-b31c-421aac30f6d9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:55:06,850::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:55:06,850::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658074', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154057', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:55:06,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d921b59-9af5-4e76-b31c-421aac30f6d9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658074', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154057', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:55:06,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d921b59-9af5-4e76-b31c-421aac30f6d9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:55:06,851::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:55:06,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:55:06,851::task::993::Storage.TaskManager.Task::(_decref) Task=`1d921b59-9af5-4e76-b31c-421aac30f6d9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:55:11,260::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:55:11,268::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764463 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:55:11,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:55:11,431::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656248 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:55:21,271::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:55:21,280::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695181 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:55:21,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:55:21,439::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006451 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:55:21,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`f82a90fa-8f06-4e8f-a9ee-2e69f3f41a69`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:55:21,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:55:21,962::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006451', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695181', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:55:21,962::task::1191::Storage.TaskManager.Task::(prepare) Task=`f82a90fa-8f06-4e8f-a9ee-2e69f3f41a69`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006451', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695181', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:55:21,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`f82a90fa-8f06-4e8f-a9ee-2e69f3f41a69`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:55:21,963::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:55:21,963::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:55:21,963::task::993::Storage.TaskManager.Task::(_decref) Task=`f82a90fa-8f06-4e8f-a9ee-2e69f3f41a69`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:55:31,283::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:55:31,291::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617055 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:55:31,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:55:31,449::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000570636 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:55:37,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`dfdd148d-7742-4b13-aa14-9c16d3df4ca7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:55:37,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:55:37,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570636', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617055', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:55:37,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`dfdd148d-7742-4b13-aa14-9c16d3df4ca7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570636', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617055', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:55:37,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`dfdd148d-7742-4b13-aa14-9c16d3df4ca7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:55:37,089::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:55:37,089::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:55:37,090::task::993::Storage.TaskManager.Task::(_decref) Task=`dfdd148d-7742-4b13-aa14-9c16d3df4ca7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:55:41,294::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:55:41,302::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000786513 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:55:41,451::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:55:41,458::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721285 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:55:51,306::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:55:51,316::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661434 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:55:51,460::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:55:51,470::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614163 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:55:52,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b5542a2-bb59-4612-b6bd-29318cb0db92`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:55:52,207::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:55:52,207::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614163', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661434', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:55:52,207::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b5542a2-bb59-4612-b6bd-29318cb0db92`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614163', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661434', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:55:52,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b5542a2-bb59-4612-b6bd-29318cb0db92`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:55:52,208::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:55:52,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:55:52,208::task::993::Storage.TaskManager.Task::(_decref) Task=`1b5542a2-bb59-4612-b6bd-29318cb0db92`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:56:01,319::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:56:01,327::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666052 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:56:01,472::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:56:01,480::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715804 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:56:07,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cb68587-9152-4405-9a52-e5af83855ea8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:56:07,325::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:56:07,326::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715804', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666052', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:56:07,326::task::1191::Storage.TaskManager.Task::(prepare) Task=`1cb68587-9152-4405-9a52-e5af83855ea8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715804', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666052', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:56:07,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cb68587-9152-4405-9a52-e5af83855ea8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:56:07,326::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:56:07,326::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:56:07,326::task::993::Storage.TaskManager.Task::(_decref) Task=`1cb68587-9152-4405-9a52-e5af83855ea8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:56:11,330::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:56:11,338::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702086 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:56:11,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:56:11,489::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612222 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:56:21,342::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:56:21,350::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663227 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:56:21,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:56:21,498::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070182 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:56:22,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`674b8c96-430c-443c-bdfb-0efb06e492da`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:56:22,438::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:56:22,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070182', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663227', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:56:22,440::task::1191::Storage.TaskManager.Task::(prepare) Task=`674b8c96-430c-443c-bdfb-0efb06e492da`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070182', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663227', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:56:22,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`674b8c96-430c-443c-bdfb-0efb06e492da`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:56:22,441::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:56:22,442::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:56:22,443::task::993::Storage.TaskManager.Task::(_decref) Task=`674b8c96-430c-443c-bdfb-0efb06e492da`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:56:31,353::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:56:31,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072044 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:56:31,500::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:56:31,508::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591456 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:56:37,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9f7ed23-b538-4153-9a52-1e48463e8bae`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:56:37,578::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:56:37,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591456', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072044', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:56:37,579::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9f7ed23-b538-4153-9a52-1e48463e8bae`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591456', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072044', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:56:37,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9f7ed23-b538-4153-9a52-1e48463e8bae`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:56:37,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:56:37,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:56:37,580::task::993::Storage.TaskManager.Task::(_decref) Task=`d9f7ed23-b538-4153-9a52-1e48463e8bae`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:56:41,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:56:41,374::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00356261 s, 1.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:56:41,510::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:56:41,520::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00430026 s, 953 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:56:51,378::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:56:51,387::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636852 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:56:51,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:56:51,529::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595813 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:56:52,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f5c2144-ebd0-46d7-9be9-b5116541495e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:56:52,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:56:52,727::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595813', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636852', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:56:52,728::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f5c2144-ebd0-46d7-9be9-b5116541495e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595813', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636852', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:56:52,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f5c2144-ebd0-46d7-9be9-b5116541495e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:56:52,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:56:52,730::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:56:52,731::task::993::Storage.TaskManager.Task::(_decref) Task=`7f5c2144-ebd0-46d7-9be9-b5116541495e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:57:01,390::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:57:01,398::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698552 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:57:01,531::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:57:01,539::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729148 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:57:07,861::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7b24c49-03b2-475a-a677-ad06cb059e8a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:57:07,861::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:57:07,862::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729148', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698552', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:57:07,862::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7b24c49-03b2-475a-a677-ad06cb059e8a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729148', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698552', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:57:07,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7b24c49-03b2-475a-a677-ad06cb059e8a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:57:07,862::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:57:07,862::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:57:07,863::task::993::Storage.TaskManager.Task::(_decref) Task=`f7b24c49-03b2-475a-a677-ad06cb059e8a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:57:11,401::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:57:11,410::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000793509 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:57:11,540::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:57:11,547::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625007 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:57:21,413::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:57:21,421::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646348 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:57:21,549::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:57:21,557::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575704 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:57:22,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`f69122e7-fe6e-453d-afe3-4a68581aeefb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:57:22,974::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:57:22,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575704', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646348', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:57:22,976::task::1191::Storage.TaskManager.Task::(prepare) Task=`f69122e7-fe6e-453d-afe3-4a68581aeefb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575704', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646348', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:57:22,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`f69122e7-fe6e-453d-afe3-4a68581aeefb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:57:22,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:57:22,977::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:57:22,978::task::993::Storage.TaskManager.Task::(_decref) Task=`f69122e7-fe6e-453d-afe3-4a68581aeefb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:57:31,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:57:31,433::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813543 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:57:31,559::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:57:31,567::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567197 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:57:38,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`997dcac0-c6e7-4a35-a2a5-8a836a1f3db0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:57:38,119::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:57:38,120::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567197', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813543', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:57:38,120::task::1191::Storage.TaskManager.Task::(prepare) Task=`997dcac0-c6e7-4a35-a2a5-8a836a1f3db0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567197', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813543', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:57:38,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`997dcac0-c6e7-4a35-a2a5-8a836a1f3db0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:57:38,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:57:38,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:57:38,121::task::993::Storage.TaskManager.Task::(_decref) Task=`997dcac0-c6e7-4a35-a2a5-8a836a1f3db0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:57:41,436::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:57:41,444::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611018 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:57:41,568::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:57:41,576::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626157 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:57:51,447::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:57:51,456::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569541 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:57:51,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:57:51,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000508779 s, 8.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:57:53,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`ead7a432-1e70-4834-b605-62f061ff274d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:57:53,242::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:57:53,243::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508779', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569541', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:57:53,244::task::1191::Storage.TaskManager.Task::(prepare) Task=`ead7a432-1e70-4834-b605-62f061ff274d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508779', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569541', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:57:53,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`ead7a432-1e70-4834-b605-62f061ff274d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:57:53,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:57:53,246::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:57:53,247::task::993::Storage.TaskManager.Task::(_decref) Task=`ead7a432-1e70-4834-b605-62f061ff274d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:58:01,459::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:58:01,467::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000783604 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:01,588::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:01,596::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672297 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:58:08,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de9a9d1-e14c-4049-9b7f-9ea7f4785e37`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:58:08,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:58:08,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672297', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783604', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:58:08,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`9de9a9d1-e14c-4049-9b7f-9ea7f4785e37`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672297', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783604', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:58:08,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de9a9d1-e14c-4049-9b7f-9ea7f4785e37`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:58:08,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:58:08,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:58:08,385::task::993::Storage.TaskManager.Task::(_decref) Task=`9de9a9d1-e14c-4049-9b7f-9ea7f4785e37`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:58:11,470::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:58:11,478::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663487 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:11,597::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:11,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596196 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:58:21,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:58:21,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581121 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:21,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:21,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690344 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:58:23,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2869d04-92c2-4300-adae-44ded8967f61`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:58:23,482::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:58:23,483::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690344', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581121', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:58:23,483::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2869d04-92c2-4300-adae-44ded8967f61`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690344', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581121', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:58:23,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2869d04-92c2-4300-adae-44ded8967f61`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:58:23,483::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:58:23,483::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:58:23,484::task::993::Storage.TaskManager.Task::(_decref) Task=`f2869d04-92c2-4300-adae-44ded8967f61`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:58:31,493::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 15:58:31,493::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:58:31,494::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:58:31,502::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00074591 s, 2.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:58:31,502::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00074591 s, 2.7 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 15:58:31,502::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 15:58:31,502::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 15:58:31,503::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 15:58:31,503::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:58:31,503::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:58:31,503::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:58:31,504::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:58:31,504::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 15:58:31,504::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:31,616::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 15:58:31,617::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:58:31,617::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:31,626::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000650894 s, 3.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:31,626::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000650894 s, 3.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 15:58:31,626::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 15:58:31,627::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 15:58:31,627::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 15:58:31,627::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 15:58:31,733::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:58:31,734::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 15:58:31,735::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 15:58:31,735::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:58:31,738::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 15:58:31,739::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 15:58:31,740::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::DEBUG::2014-08-12 15:58:31,740::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 15:58:31,741::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 15:58:31,743::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:31,743::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:58:31,752::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 15:58:31,752::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 15:58:31,910::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:58:31,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:58:31,919::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583846 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:31,935::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:31,936::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 15:58:31,936::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 15:58:31,937::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 15:58:31,937::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 15:58:31,937::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 15:58:31,937::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:32,105::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:32,105::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:32,114::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114897 s, 3.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:58:38,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d2340ff-9ef9-402f-9c27-cc54fc0a6fef`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:58:38,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:58:38,602::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114897', 'lastCheck': '6.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583846', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:58:38,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d2340ff-9ef9-402f-9c27-cc54fc0a6fef`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114897', 'lastCheck': '6.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583846', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:58:38,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d2340ff-9ef9-402f-9c27-cc54fc0a6fef`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:58:38,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:58:38,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:58:38,603::task::993::Storage.TaskManager.Task::(_decref) Task=`1d2340ff-9ef9-402f-9c27-cc54fc0a6fef`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:58:41,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:58:41,930::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719806 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:42,115::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:42,122::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070428 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:58:51,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:58:51,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00129107 s, 3.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:58:52,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:58:52,134::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00255716 s, 1.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:58:53,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`68898a57-7169-4634-b98f-a83afb0f28ed`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:58:53,723::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:58:53,723::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255716', 'lastCheck': '1.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129107', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:58:53,724::task::1191::Storage.TaskManager.Task::(prepare) Task=`68898a57-7169-4634-b98f-a83afb0f28ed`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255716', 'lastCheck': '1.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129107', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:58:53,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`68898a57-7169-4634-b98f-a83afb0f28ed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:58:53,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:58:53,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:58:53,724::task::993::Storage.TaskManager.Task::(_decref) Task=`68898a57-7169-4634-b98f-a83afb0f28ed`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:59:01,946::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:59:01,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713175 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:59:02,136::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:59:02,144::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630176 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:59:08,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`c198b128-a6c9-4a8d-99d4-50dff67c5ccd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:59:08,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:59:08,863::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630176', 'lastCheck': '6.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713175', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:59:08,863::task::1191::Storage.TaskManager.Task::(prepare) Task=`c198b128-a6c9-4a8d-99d4-50dff67c5ccd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630176', 'lastCheck': '6.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713175', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:59:08,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`c198b128-a6c9-4a8d-99d4-50dff67c5ccd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:59:08,863::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:59:08,863::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:59:08,863::task::993::Storage.TaskManager.Task::(_decref) Task=`c198b128-a6c9-4a8d-99d4-50dff67c5ccd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:59:11,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:59:11,966::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628962 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:59:12,146::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:59:12,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590012 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:59:21,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:59:21,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598441 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:59:22,157::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:59:22,166::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610441 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:59:24,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f4e7190-90d7-4128-aab1-af35ad9b6116`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:59:24,040::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:59:24,051::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610441', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598441', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:59:24,051::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f4e7190-90d7-4128-aab1-af35ad9b6116`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610441', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598441', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:59:24,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f4e7190-90d7-4128-aab1-af35ad9b6116`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:59:24,051::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:59:24,052::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:59:24,052::task::993::Storage.TaskManager.Task::(_decref) Task=`3f4e7190-90d7-4128-aab1-af35ad9b6116`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:59:31,981::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:59:31,989::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728735 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:59:32,167::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:59:32,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062067 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:59:39,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`366833aa-7e3b-4716-9ae7-3a38f92011e7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:59:39,236::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:59:39,237::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062067', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728735', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:59:39,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`366833aa-7e3b-4716-9ae7-3a38f92011e7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062067', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728735', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:59:39,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`366833aa-7e3b-4716-9ae7-3a38f92011e7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:59:39,237::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:59:39,237::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:59:39,238::task::993::Storage.TaskManager.Task::(_decref) Task=`366833aa-7e3b-4716-9ae7-3a38f92011e7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 15:59:41,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:59:42,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722043 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:59:42,177::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:59:42,185::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701537 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 15:59:52,004::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 15:59:52,012::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000543346 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 15:59:52,187::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 15:59:52,196::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00051722 s, 7.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 15:59:54,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`11d11576-8d5e-46ff-9d3a-e7bb227c5245`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 15:59:54,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 15:59:54,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051722', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543346', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:59:54,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`11d11576-8d5e-46ff-9d3a-e7bb227c5245`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051722', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543346', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 15:59:54,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`11d11576-8d5e-46ff-9d3a-e7bb227c5245`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 15:59:54,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 15:59:54,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 15:59:54,348::task::993::Storage.TaskManager.Task::(_decref) Task=`11d11576-8d5e-46ff-9d3a-e7bb227c5245`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:00:02,015::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:00:02,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719254 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:00:02,197::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:00:02,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609986 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:00:09,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`19d72681-1000-47a2-b351-ab133a710b83`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:00:09,457::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:00:09,457::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609986', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719254', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:00:09,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`19d72681-1000-47a2-b351-ab133a710b83`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609986', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719254', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:00:09,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`19d72681-1000-47a2-b351-ab133a710b83`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:00:09,458::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:00:09,458::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:00:09,458::task::993::Storage.TaskManager.Task::(_decref) Task=`19d72681-1000-47a2-b351-ab133a710b83`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:00:12,026::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:00:12,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000777625 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:00:12,207::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:00:12,214::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689473 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:00:22,037::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:00:22,045::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627601 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:00:22,216::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:00:22,224::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629127 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:00:24,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`44e7626e-f74e-424a-a668-834216b96136`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:00:24,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:00:24,596::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629127', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627601', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:00:24,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`44e7626e-f74e-424a-a668-834216b96136`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629127', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627601', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:00:24,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`44e7626e-f74e-424a-a668-834216b96136`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:00:24,597::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:00:24,597::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:00:24,597::task::993::Storage.TaskManager.Task::(_decref) Task=`44e7626e-f74e-424a-a668-834216b96136`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:00:32,048::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:00:32,056::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749024 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:00:32,226::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:00:32,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631471 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:00:39,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`11967baa-16d7-403f-ae0a-4cadf24efe45`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:00:39,721::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:00:39,721::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631471', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749024', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:00:39,721::task::1191::Storage.TaskManager.Task::(prepare) Task=`11967baa-16d7-403f-ae0a-4cadf24efe45`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631471', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749024', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:00:39,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`11967baa-16d7-403f-ae0a-4cadf24efe45`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:00:39,721::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:00:39,722::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:00:39,722::task::993::Storage.TaskManager.Task::(_decref) Task=`11967baa-16d7-403f-ae0a-4cadf24efe45`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:00:42,059::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:00:42,067::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692299 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:00:42,236::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:00:42,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629573 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:00:52,070::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:00:52,079::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654974 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:00:52,244::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:00:52,251::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638679 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:00:54,830::task::595::Storage.TaskManager.Task::(_updateState) Task=`18ff6fe8-b809-474a-81f1-6aeaf9abdca5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:00:54,831::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:00:54,831::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638679', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654974', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:00:54,831::task::1191::Storage.TaskManager.Task::(prepare) Task=`18ff6fe8-b809-474a-81f1-6aeaf9abdca5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638679', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654974', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:00:54,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`18ff6fe8-b809-474a-81f1-6aeaf9abdca5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:00:54,832::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:00:54,832::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:00:54,832::task::993::Storage.TaskManager.Task::(_decref) Task=`18ff6fe8-b809-474a-81f1-6aeaf9abdca5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:01:02,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:01:02,090::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642827 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:01:02,253::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:01:02,262::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666867 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:01:09,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`d68ef90b-1ed9-4372-a233-f749c06349c6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:01:09,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:01:09,951::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666867', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642827', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:01:09,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`d68ef90b-1ed9-4372-a233-f749c06349c6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666867', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642827', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:01:09,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`d68ef90b-1ed9-4372-a233-f749c06349c6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:01:09,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:01:09,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:01:09,952::task::993::Storage.TaskManager.Task::(_decref) Task=`d68ef90b-1ed9-4372-a233-f749c06349c6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:01:12,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:01:12,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000791293 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:01:12,263::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:01:12,270::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590102 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:01:22,105::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:01:22,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686491 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:01:22,271::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:01:22,280::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624052 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:01:25,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`05d8ecf6-97f2-4a61-a3d4-c21d55bde1d1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:01:25,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:01:25,067::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624052', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686491', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:01:25,067::task::1191::Storage.TaskManager.Task::(prepare) Task=`05d8ecf6-97f2-4a61-a3d4-c21d55bde1d1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624052', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686491', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:01:25,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`05d8ecf6-97f2-4a61-a3d4-c21d55bde1d1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:01:25,068::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:01:25,068::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:01:25,068::task::993::Storage.TaskManager.Task::(_decref) Task=`05d8ecf6-97f2-4a61-a3d4-c21d55bde1d1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:01:32,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:01:32,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729959 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:01:32,282::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:01:32,289::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631756 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:01:40,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4f10cbc-2395-4d00-8393-bad9deb38de1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:01:40,178::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:01:40,179::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631756', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729959', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:01:40,179::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4f10cbc-2395-4d00-8393-bad9deb38de1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631756', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729959', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:01:40,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4f10cbc-2395-4d00-8393-bad9deb38de1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:01:40,179::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:01:40,179::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:01:40,180::task::993::Storage.TaskManager.Task::(_decref) Task=`a4f10cbc-2395-4d00-8393-bad9deb38de1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:01:42,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:01:42,136::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613396 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:01:42,290::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:01:42,299::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576244 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:01:52,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:01:52,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610186 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:01:52,300::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:01:52,309::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069488 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:01:55,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6406799-716e-4d0c-9aca-47553c81d70c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:01:55,293::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:01:55,293::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069488', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610186', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:01:55,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6406799-716e-4d0c-9aca-47553c81d70c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069488', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610186', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:01:55,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6406799-716e-4d0c-9aca-47553c81d70c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:01:55,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:01:55,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:01:55,294::task::993::Storage.TaskManager.Task::(_decref) Task=`b6406799-716e-4d0c-9aca-47553c81d70c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:02:02,163::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:02:02,172::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000881896 s, 4.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:02:02,311::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:02:02,318::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694584 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:02:10,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f4f4b8d-ddb4-40ef-a05e-e86cca63a2c4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:02:10,405::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:02:10,405::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694584', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000881896', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:02:10,405::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f4f4b8d-ddb4-40ef-a05e-e86cca63a2c4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694584', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000881896', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:02:10,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f4f4b8d-ddb4-40ef-a05e-e86cca63a2c4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:02:10,405::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:02:10,406::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:02:10,406::task::993::Storage.TaskManager.Task::(_decref) Task=`7f4f4b8d-ddb4-40ef-a05e-e86cca63a2c4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:02:12,176::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:02:12,185::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715343 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:02:12,320::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:02:12,327::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664362 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:02:22,188::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:02:22,197::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668181 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:02:22,329::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:02:22,339::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592676 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:02:25,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0d426f6-4da7-442c-9eb2-546721a93ff3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:02:25,524::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:02:25,524::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592676', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668181', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:02:25,524::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0d426f6-4da7-442c-9eb2-546721a93ff3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592676', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668181', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:02:25,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0d426f6-4da7-442c-9eb2-546721a93ff3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:02:25,524::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:02:25,525::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:02:25,525::task::993::Storage.TaskManager.Task::(_decref) Task=`b0d426f6-4da7-442c-9eb2-546721a93ff3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:02:32,200::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:02:32,208::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814379 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:02:32,341::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:02:32,348::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609443 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:02:40,633::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a1662a3-95a6-43a3-8c23-668bb2f16e36`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:02:40,633::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:02:40,634::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609443', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814379', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:02:40,634::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a1662a3-95a6-43a3-8c23-668bb2f16e36`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609443', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814379', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:02:40,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a1662a3-95a6-43a3-8c23-668bb2f16e36`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:02:40,634::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:02:40,634::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:02:40,634::task::993::Storage.TaskManager.Task::(_decref) Task=`2a1662a3-95a6-43a3-8c23-668bb2f16e36`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:02:42,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:02:42,218::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634166 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:02:42,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:02:42,356::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611716 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:02:52,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:02:52,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686692 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:02:52,358::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:02:52,368::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644349 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:02:55,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2a39b0b-21e4-484a-9832-af57cda92a90`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:02:55,738::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:02:55,738::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644349', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686692', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:02:55,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2a39b0b-21e4-484a-9832-af57cda92a90`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644349', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686692', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:02:55,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2a39b0b-21e4-484a-9832-af57cda92a90`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:02:55,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:02:55,739::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:02:55,739::task::993::Storage.TaskManager.Task::(_decref) Task=`c2a39b0b-21e4-484a-9832-af57cda92a90`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:03:02,248::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:03:02,258::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613077 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:02,371::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:02,379::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617327 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:03:10,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`f69416cc-ed6c-4212-ab2a-f8c6d982513d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:03:10,852::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:03:10,853::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617327', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613077', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:03:10,853::task::1191::Storage.TaskManager.Task::(prepare) Task=`f69416cc-ed6c-4212-ab2a-f8c6d982513d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617327', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613077', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:03:10,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`f69416cc-ed6c-4212-ab2a-f8c6d982513d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:03:10,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:03:10,853::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:03:10,853::task::993::Storage.TaskManager.Task::(_decref) Task=`f69416cc-ed6c-4212-ab2a-f8c6d982513d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:03:12,261::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:03:12,270::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716948 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:12,381::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:12,388::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618934 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:03:22,274::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:03:22,281::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684321 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:22,392::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:22,404::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807296 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:03:25,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`d614f9c6-6c5f-49a6-9ca0-1fc49210d1c7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:03:25,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:03:25,961::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807296', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684321', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:03:25,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`d614f9c6-6c5f-49a6-9ca0-1fc49210d1c7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807296', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684321', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:03:25,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`d614f9c6-6c5f-49a6-9ca0-1fc49210d1c7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:03:25,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:03:25,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:03:25,961::task::993::Storage.TaskManager.Task::(_decref) Task=`d614f9c6-6c5f-49a6-9ca0-1fc49210d1c7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:03:32,285::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:03:32,285::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:03:32,285::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:03:32,294::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000751634 s, 2.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:03:32,294::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000751634 s, 2.7 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:03:32,294::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:03:32,295::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:03:32,295::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:03:32,295::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:03:32,295::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:03:32,296::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:03:32,296::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:03:32,296::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:03:32,296::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:32,409::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:03:32,410::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:03:32,410::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:32,419::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000671804 s, 3.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:32,420::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000671804 s, 3.0 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:03:32,420::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:03:32,420::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:03:32,420::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:03:32,421::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 16:03:32,569::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:03:32,570::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:03:32,571::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 16:03:32,571::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:03:32,574::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 16:03:32,575::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:03:32,576::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:03:32,577::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:03:32,577::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:03:32,579::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:32,586::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:03:32,588::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:03:32,589::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:03:32,748::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:03:32,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:03:32,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000486543 s, 8.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:32,774::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:32,775::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:03:32,775::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:03:32,776::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:03:32,776::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:03:32,776::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:03:32,777::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:32,944::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:32,945::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:32,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640467 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:03:41,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`723a340c-ed5a-47a6-a1bf-4590ea84fa61`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:03:41,066::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:03:41,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640467', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486543', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:03:41,066::task::1191::Storage.TaskManager.Task::(prepare) Task=`723a340c-ed5a-47a6-a1bf-4590ea84fa61`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640467', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486543', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:03:41,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`723a340c-ed5a-47a6-a1bf-4590ea84fa61`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:03:41,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:03:41,067::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:03:41,067::task::993::Storage.TaskManager.Task::(_decref) Task=`723a340c-ed5a-47a6-a1bf-4590ea84fa61`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:03:42,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:03:42,768::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579369 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:42,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:42,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659868 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:03:52,774::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:03:52,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764753 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:03:52,966::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:03:52,980::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000691005 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:03:56,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`94f6a47c-4cad-4c35-8850-0e717c277c92`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:03:56,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:03:56,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691005', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764753', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:03:56,184::task::1191::Storage.TaskManager.Task::(prepare) Task=`94f6a47c-4cad-4c35-8850-0e717c277c92`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691005', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764753', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:03:56,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`94f6a47c-4cad-4c35-8850-0e717c277c92`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:03:56,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:03:56,185::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:03:56,185::task::993::Storage.TaskManager.Task::(_decref) Task=`94f6a47c-4cad-4c35-8850-0e717c277c92`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:04:02,821::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:04:02,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00744825 s, 550 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:04:02,986::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:04:02,994::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000566054 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:04:11,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`aff184f4-b1ea-4eea-a582-fd8dc63ddcdc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:04:11,296::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:04:11,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566054', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00744825', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:04:11,297::task::1191::Storage.TaskManager.Task::(prepare) Task=`aff184f4-b1ea-4eea-a582-fd8dc63ddcdc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566054', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00744825', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:04:11,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`aff184f4-b1ea-4eea-a582-fd8dc63ddcdc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:04:11,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:04:11,297::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:04:11,297::task::993::Storage.TaskManager.Task::(_decref) Task=`aff184f4-b1ea-4eea-a582-fd8dc63ddcdc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:04:12,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:04:12,849::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746304 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:04:12,996::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:04:13,003::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612083 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:04:22,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:04:22,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000510995 s, 8.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:04:23,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:04:23,015::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710162 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:04:26,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`586b3769-792b-4439-adb2-31648ff1beb8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:04:26,411::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:04:26,411::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710162', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510995', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:04:26,411::task::1191::Storage.TaskManager.Task::(prepare) Task=`586b3769-792b-4439-adb2-31648ff1beb8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710162', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510995', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:04:26,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`586b3769-792b-4439-adb2-31648ff1beb8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:04:26,411::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:04:26,411::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:04:26,412::task::993::Storage.TaskManager.Task::(_decref) Task=`586b3769-792b-4439-adb2-31648ff1beb8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:04:32,870::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:04:32,878::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699735 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:04:33,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:04:33,027::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681156 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:04:41,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2b395fa-b588-464e-9d20-2eda1f05803a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:04:41,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:04:41,518::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681156', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699735', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:04:41,518::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2b395fa-b588-464e-9d20-2eda1f05803a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681156', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699735', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:04:41,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2b395fa-b588-464e-9d20-2eda1f05803a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:04:41,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:04:41,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:04:41,518::task::993::Storage.TaskManager.Task::(_decref) Task=`e2b395fa-b588-464e-9d20-2eda1f05803a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:04:42,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:04:42,889::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746211 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:04:43,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:04:43,037::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650218 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:04:52,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:04:52,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665545 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:04:53,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:04:53,049::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067913 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:04:56,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e7335cf-5d97-470f-b6d7-e8635266365f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:04:56,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:04:56,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067913', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665545', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:04:56,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e7335cf-5d97-470f-b6d7-e8635266365f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067913', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665545', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:04:56,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e7335cf-5d97-470f-b6d7-e8635266365f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:04:56,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:04:56,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:04:56,627::task::993::Storage.TaskManager.Task::(_decref) Task=`3e7335cf-5d97-470f-b6d7-e8635266365f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:05:02,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:05:02,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572871 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:05:03,052::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:05:03,060::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698479 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:05:11,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6dafdfb-7224-4fa2-9d43-42375766d909`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:05:11,766::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:05:11,767::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698479', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572871', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:05:11,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6dafdfb-7224-4fa2-9d43-42375766d909`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698479', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572871', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:05:11,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6dafdfb-7224-4fa2-9d43-42375766d909`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:05:11,767::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:05:11,767::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:05:11,767::task::993::Storage.TaskManager.Task::(_decref) Task=`e6dafdfb-7224-4fa2-9d43-42375766d909`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:05:12,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:05:12,934::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725827 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:05:13,062::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:05:13,069::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725965 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:05:22,938::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:05:22,949::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706313 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:05:23,073::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:05:23,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579335 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:05:26,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`273f2a13-f945-4628-af0a-7de13a990fd8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:05:26,896::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:05:26,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579335', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706313', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:05:26,897::task::1191::Storage.TaskManager.Task::(prepare) Task=`273f2a13-f945-4628-af0a-7de13a990fd8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579335', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706313', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:05:26,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`273f2a13-f945-4628-af0a-7de13a990fd8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:05:26,897::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:05:26,897::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:05:26,898::task::993::Storage.TaskManager.Task::(_decref) Task=`273f2a13-f945-4628-af0a-7de13a990fd8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:05:32,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:05:32,966::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690816 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:05:33,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:05:33,097::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668758 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:05:42,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`91c7220a-93a4-43a0-8253-540d23b2d9da`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:05:42,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:05:42,019::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668758', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690816', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:05:42,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`91c7220a-93a4-43a0-8253-540d23b2d9da`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668758', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690816', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:05:42,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`91c7220a-93a4-43a0-8253-540d23b2d9da`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:05:42,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:05:42,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:05:42,020::task::993::Storage.TaskManager.Task::(_decref) Task=`91c7220a-93a4-43a0-8253-540d23b2d9da`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:05:42,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:05:42,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593822 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:05:43,099::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:05:43,107::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698313 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:05:52,982::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:05:52,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647126 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:05:53,111::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:05:53,120::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692743 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:05:57,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`7595d99a-40b5-4687-8dab-8be54ffe333b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:05:57,127::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:05:57,127::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692743', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647126', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:05:57,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`7595d99a-40b5-4687-8dab-8be54ffe333b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692743', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647126', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:05:57,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`7595d99a-40b5-4687-8dab-8be54ffe333b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:05:57,127::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:05:57,127::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:05:57,128::task::993::Storage.TaskManager.Task::(_decref) Task=`7595d99a-40b5-4687-8dab-8be54ffe333b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:06:03,003::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:06:03,012::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714135 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:06:03,123::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:06:03,131::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644056 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:06:12,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc0445e9-2db6-414d-a98e-0f2e96ada540`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:06:12,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:06:12,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644056', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714135', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:06:12,244::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc0445e9-2db6-414d-a98e-0f2e96ada540`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644056', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714135', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:06:12,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc0445e9-2db6-414d-a98e-0f2e96ada540`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:06:12,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:06:12,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:06:12,245::task::993::Storage.TaskManager.Task::(_decref) Task=`dc0445e9-2db6-414d-a98e-0f2e96ada540`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:06:13,032::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:06:13,039::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000768093 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:06:13,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:06:13,140::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006603 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:06:23,043::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:06:23,053::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000536147 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:06:23,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:06:23,152::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593595 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:06:27,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6def37d-c037-4f79-9586-4e4e8715e26a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:06:27,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:06:27,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593595', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536147', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:06:27,361::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6def37d-c037-4f79-9586-4e4e8715e26a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593595', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536147', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:06:27,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6def37d-c037-4f79-9586-4e4e8715e26a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:06:27,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:06:27,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:06:27,362::task::993::Storage.TaskManager.Task::(_decref) Task=`f6def37d-c037-4f79-9586-4e4e8715e26a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:06:33,062::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:06:33,070::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700588 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:06:33,156::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:06:33,164::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587003 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:06:42,473::task::595::Storage.TaskManager.Task::(_updateState) Task=`e75f014c-1491-4eda-992e-29e3bffcbfe5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:06:42,473::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:06:42,474::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587003', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700588', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:06:42,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`e75f014c-1491-4eda-992e-29e3bffcbfe5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587003', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700588', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:06:42,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`e75f014c-1491-4eda-992e-29e3bffcbfe5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:06:42,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:06:42,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:06:42,474::task::993::Storage.TaskManager.Task::(_decref) Task=`e75f014c-1491-4eda-992e-29e3bffcbfe5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:06:43,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:06:43,121::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731201 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:06:43,166::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:06:43,172::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000553384 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:06:53,126::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:06:53,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650371 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:06:53,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:06:53,185::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700419 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:06:57,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a5a4291-64ba-480f-a80d-2088afa9d6b2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:06:57,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:06:57,577::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700419', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650371', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:06:57,577::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a5a4291-64ba-480f-a80d-2088afa9d6b2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700419', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650371', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:06:57,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a5a4291-64ba-480f-a80d-2088afa9d6b2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:06:57,577::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:06:57,577::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:06:57,577::task::993::Storage.TaskManager.Task::(_decref) Task=`2a5a4291-64ba-480f-a80d-2088afa9d6b2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:07:03,148::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:07:03,159::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00275407 s, 1.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:07:03,189::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:07:03,197::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585068 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:07:12,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`18af66f8-a452-4c8c-8730-11f9eeabd2bb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:07:12,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:07:12,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585068', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00275407', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:07:12,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`18af66f8-a452-4c8c-8730-11f9eeabd2bb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585068', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00275407', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:07:12,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`18af66f8-a452-4c8c-8730-11f9eeabd2bb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:07:12,690::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:07:12,690::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:07:12,691::task::993::Storage.TaskManager.Task::(_decref) Task=`18af66f8-a452-4c8c-8730-11f9eeabd2bb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:07:13,162::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:07:13,170::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739459 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:07:13,199::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:07:13,207::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621242 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:07:23,174::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:07:23,184::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00183244 s, 2.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:07:23,210::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:07:23,220::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007194 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:07:27,801::task::595::Storage.TaskManager.Task::(_updateState) Task=`9920040c-fb58-45a7-bd9b-8674ae36eccb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:07:27,801::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:07:27,801::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007194', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00183244', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:07:27,801::task::1191::Storage.TaskManager.Task::(prepare) Task=`9920040c-fb58-45a7-bd9b-8674ae36eccb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007194', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00183244', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:07:27,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`9920040c-fb58-45a7-bd9b-8674ae36eccb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:07:27,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:07:27,802::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:07:27,802::task::993::Storage.TaskManager.Task::(_decref) Task=`9920040c-fb58-45a7-bd9b-8674ae36eccb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:07:33,192::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:07:33,200::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073746 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:07:33,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:07:33,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617896 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:07:42,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b0c35e8-3871-4b6b-866c-81688cc3bf3d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:07:42,907::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:07:42,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617896', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073746', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:07:42,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b0c35e8-3871-4b6b-866c-81688cc3bf3d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617896', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073746', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:07:42,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b0c35e8-3871-4b6b-866c-81688cc3bf3d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:07:42,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:07:42,908::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:07:42,908::task::993::Storage.TaskManager.Task::(_decref) Task=`3b0c35e8-3871-4b6b-866c-81688cc3bf3d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:07:43,203::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:07:43,212::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641482 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:07:43,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:07:43,240::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594568 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:07:53,216::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:07:53,225::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673096 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:07:53,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:07:53,253::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068539 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:07:58,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`e989d845-4deb-4d49-888c-f746355eb645`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:07:58,019::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:07:58,019::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068539', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673096', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:07:58,020::task::1191::Storage.TaskManager.Task::(prepare) Task=`e989d845-4deb-4d49-888c-f746355eb645`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068539', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673096', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:07:58,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`e989d845-4deb-4d49-888c-f746355eb645`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:07:58,020::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:07:58,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:07:58,020::task::993::Storage.TaskManager.Task::(_decref) Task=`e989d845-4deb-4d49-888c-f746355eb645`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:08:03,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:03,242::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740794 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:08:03,256::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:03,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00054377 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:08:13,143::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa688633-85b3-4b2c-aad1-4d14abf8f891`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:08:13,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:08:13,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054377', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740794', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:08:13,144::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa688633-85b3-4b2c-aad1-4d14abf8f891`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054377', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740794', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:08:13,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa688633-85b3-4b2c-aad1-4d14abf8f891`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:08:13,145::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:08:13,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:08:13,145::task::993::Storage.TaskManager.Task::(_decref) Task=`fa688633-85b3-4b2c-aad1-4d14abf8f891`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:08:13,246::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:13,254::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079014 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:08:13,266::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:13,273::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631117 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:08:23,258::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:23,268::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000551236 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:08:23,280::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:23,294::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528277 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:08:28,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`29107bc2-3cde-401c-99c1-eedd19b7fd5b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:08:28,251::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:08:28,252::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528277', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551236', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:08:28,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`29107bc2-3cde-401c-99c1-eedd19b7fd5b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528277', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551236', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:08:28,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`29107bc2-3cde-401c-99c1-eedd19b7fd5b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:08:28,252::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:08:28,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:08:28,252::task::993::Storage.TaskManager.Task::(_decref) Task=`29107bc2-3cde-401c-99c1-eedd19b7fd5b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:08:33,294::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:08:33,295::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:08:33,295::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:33,303::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:08:33,305::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:08:33,305::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000567228 s, 3.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:08:33,306::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000567228 s, 3.6 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:08:33,306::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:33,307::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:08:33,314::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:08:33,314::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:08:33,315::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000521018 s, 3.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:08:33,316::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000521018 s, 3.9 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:08:33,316::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:08:33,317::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:08:33,317::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:08:33,318::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:08:33,318::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:08:33,319::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:08:33,319::lvm::505::Storage.OperationMutex::(_invalidatelvs) Got the operational mutex >Thread-16::DEBUG::2014-08-12 16:08:33,319::lvm::505::Storage.OperationMutex::(_invalidatelvs) Got the operational mutex >Thread-16::DEBUG::2014-08-12 16:08:33,320::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:08:33,320::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:08:33,321::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:33,321::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-16::DEBUG::2014-08-12 16:08:33,328::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:33,604::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:08:33,605::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:08:33,607::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 16:08:33,608::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:08:33,611::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::INFO::2014-08-12 16:08:33,614::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:08:33,615::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:08:33,616::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::INFO::2014-08-12 16:08:33,616::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:08:33,618::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:08:33,619::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:08:33,619::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:33,628::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:33,794::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:08:33,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:33,803::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:08:33,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000491993 s, 8.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:08:33,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:33,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00049509 s, 8.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:08:43,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d7db92c-2e11-4a6b-949d-9da04d264112`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:08:43,367::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:08:43,367::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491993', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049509', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:08:43,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d7db92c-2e11-4a6b-949d-9da04d264112`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491993', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049509', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:08:43,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d7db92c-2e11-4a6b-949d-9da04d264112`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:08:43,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:08:43,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:08:43,368::task::993::Storage.TaskManager.Task::(_decref) Task=`7d7db92c-2e11-4a6b-949d-9da04d264112`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:08:43,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:43,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731122 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:08:43,827::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:43,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062984 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:08:53,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:08:53,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652281 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:08:53,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:08:53,858::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594167 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:08:58,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`daad790d-57df-489c-820c-1216fef5cc6f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:08:58,476::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:08:58,476::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652281', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594167', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:08:58,477::task::1191::Storage.TaskManager.Task::(prepare) Task=`daad790d-57df-489c-820c-1216fef5cc6f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652281', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594167', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:08:58,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`daad790d-57df-489c-820c-1216fef5cc6f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:08:58,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:08:58,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:08:58,477::task::993::Storage.TaskManager.Task::(_decref) Task=`daad790d-57df-489c-820c-1216fef5cc6f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:09:03,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:09:03,869::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:09:03,869::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677528 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:09:03,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588168 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:09:13,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`d23d5de3-5c42-4b5d-a98a-f851c0d9dce7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:09:13,586::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:09:13,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677528', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588168', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:09:13,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`d23d5de3-5c42-4b5d-a98a-f851c0d9dce7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677528', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588168', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:09:13,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`d23d5de3-5c42-4b5d-a98a-f851c0d9dce7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:09:13,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:09:13,587::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:09:13,587::task::993::Storage.TaskManager.Task::(_decref) Task=`d23d5de3-5c42-4b5d-a98a-f851c0d9dce7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:09:13,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:09:13,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651865 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:09:13,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:09:13,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678595 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:09:23,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:09:23,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000565966 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:09:23,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:09:23,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540568 s, 7.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:09:28,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`d55f6a6b-2fb3-42f5-bc5f-7bcc9a40e3ca`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:09:28,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:09:28,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565966', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540568', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:09:28,701::task::1191::Storage.TaskManager.Task::(prepare) Task=`d55f6a6b-2fb3-42f5-bc5f-7bcc9a40e3ca`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565966', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540568', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:09:28,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`d55f6a6b-2fb3-42f5-bc5f-7bcc9a40e3ca`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:09:28,702::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:09:28,702::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:09:28,702::task::993::Storage.TaskManager.Task::(_decref) Task=`d55f6a6b-2fb3-42f5-bc5f-7bcc9a40e3ca`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:09:33,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:09:33,930::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667207 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:09:33,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:09:33,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621312 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:09:43,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f24ccc9-8abe-49ff-bba7-d828a2f76507`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:09:43,812::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:09:43,812::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667207', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621312', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:09:43,812::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f24ccc9-8abe-49ff-bba7-d828a2f76507`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667207', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621312', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:09:43,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f24ccc9-8abe-49ff-bba7-d828a2f76507`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:09:43,813::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:09:43,813::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:09:43,813::task::993::Storage.TaskManager.Task::(_decref) Task=`6f24ccc9-8abe-49ff-bba7-d828a2f76507`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:09:43,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:09:43,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662554 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:09:43,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:09:43,963::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591807 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:09:53,963::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:09:53,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670243 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:09:53,973::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:09:53,981::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00152475 s, 2.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:09:58,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b9211ca-09b1-4ec6-b11a-7e3d4dd5f7b4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:09:58,923::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:09:58,924::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670243', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152475', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:09:58,924::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b9211ca-09b1-4ec6-b11a-7e3d4dd5f7b4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670243', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152475', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:09:58,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b9211ca-09b1-4ec6-b11a-7e3d4dd5f7b4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:09:58,924::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:09:58,924::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:09:58,924::task::993::Storage.TaskManager.Task::(_decref) Task=`5b9211ca-09b1-4ec6-b11a-7e3d4dd5f7b4`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:10:03,981::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:10:03,991::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696003 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:10:03,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:10:04,003::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600733 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:10:14,004::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:10:14,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:10:14,015::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700116 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:10:14,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630514 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:10:14,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7569799-dcde-4795-a466-cbf6a4eeb3b4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:10:14,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:10:14,047::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700116', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630514', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:10:14,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7569799-dcde-4795-a466-cbf6a4eeb3b4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700116', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630514', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:10:14,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7569799-dcde-4795-a466-cbf6a4eeb3b4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:10:14,047::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:10:14,047::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:10:14,048::task::993::Storage.TaskManager.Task::(_decref) Task=`e7569799-dcde-4795-a466-cbf6a4eeb3b4`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:10:24,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:10:24,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000542213 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:10:24,035::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:10:24,045::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719902 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:10:29,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fa93557-c5d5-4e81-8e34-717e8733cccc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:10:29,161::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:10:29,161::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542213', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719902', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:10:29,162::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fa93557-c5d5-4e81-8e34-717e8733cccc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542213', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719902', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:10:29,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fa93557-c5d5-4e81-8e34-717e8733cccc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:10:29,162::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:10:29,162::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:10:29,162::task::993::Storage.TaskManager.Task::(_decref) Task=`7fa93557-c5d5-4e81-8e34-717e8733cccc`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:10:34,045::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:10:34,054::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000537197 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:10:34,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:10:34,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000490174 s, 8.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:10:44,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:10:44,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747502 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:10:44,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:10:44,084::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636814 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:10:44,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6c53fae-33c0-4670-9b38-037fe1d78db0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:10:44,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:10:44,277::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000747502', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636814', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:10:44,277::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6c53fae-33c0-4670-9b38-037fe1d78db0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000747502', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636814', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:10:44,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6c53fae-33c0-4670-9b38-037fe1d78db0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:10:44,277::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:10:44,277::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:10:44,277::task::993::Storage.TaskManager.Task::(_decref) Task=`f6c53fae-33c0-4670-9b38-037fe1d78db0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:10:54,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:10:54,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:10:54,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587018 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:10:54,105::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645001 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:10:59,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d3b222d-4aa2-462c-bfa0-ee007483de53`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:10:59,388::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:10:59,389::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587018', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645001', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:10:59,389::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d3b222d-4aa2-462c-bfa0-ee007483de53`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587018', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645001', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:10:59,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d3b222d-4aa2-462c-bfa0-ee007483de53`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:10:59,389::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:10:59,389::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:10:59,389::task::993::Storage.TaskManager.Task::(_decref) Task=`2d3b222d-4aa2-462c-bfa0-ee007483de53`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:11:04,106::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:11:04,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774335 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:11:04,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:11:04,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719613 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:11:14,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:11:14,136::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678349 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:11:14,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:11:14,144::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612197 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:11:14,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5a78a70-c99c-4eeb-a599-ed0b91226cfe`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:11:14,508::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:11:14,508::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678349', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612197', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:11:14,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5a78a70-c99c-4eeb-a599-ed0b91226cfe`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678349', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612197', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:11:14,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5a78a70-c99c-4eeb-a599-ed0b91226cfe`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:11:14,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:11:14,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:11:14,509::task::993::Storage.TaskManager.Task::(_decref) Task=`c5a78a70-c99c-4eeb-a599-ed0b91226cfe`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:11:24,145::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:11:24,154::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642694 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:11:24,154::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:11:24,163::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651881 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:11:29,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`925edeaf-d1f1-4a2c-8b51-7a44e5f35650`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:11:29,610::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:11:29,610::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642694', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651881', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:11:29,610::task::1191::Storage.TaskManager.Task::(prepare) Task=`925edeaf-d1f1-4a2c-8b51-7a44e5f35650`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642694', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651881', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:11:29,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`925edeaf-d1f1-4a2c-8b51-7a44e5f35650`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:11:29,610::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:11:29,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:11:29,611::task::993::Storage.TaskManager.Task::(_decref) Task=`925edeaf-d1f1-4a2c-8b51-7a44e5f35650`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:11:34,163::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:11:34,173::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071225 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:11:34,173::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:11:34,184::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567621 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:11:44,184::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:11:44,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690472 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:11:44,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:11:44,203::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583827 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:11:44,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4f6f0b6-b89c-4bf3-946a-65a25f52198a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:11:44,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:11:44,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690472', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583827', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:11:44,719::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4f6f0b6-b89c-4bf3-946a-65a25f52198a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690472', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583827', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:11:44,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4f6f0b6-b89c-4bf3-946a-65a25f52198a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:11:44,719::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:11:44,719::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:11:44,719::task::993::Storage.TaskManager.Task::(_decref) Task=`f4f6f0b6-b89c-4bf3-946a-65a25f52198a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:11:54,203::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:11:54,213::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623246 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:11:54,213::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:11:54,224::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000761973 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:11:59,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e287400-f69f-45fb-a292-bd29e945fb36`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:11:59,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:11:59,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623246', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761973', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:11:59,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e287400-f69f-45fb-a292-bd29e945fb36`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623246', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761973', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:11:59,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e287400-f69f-45fb-a292-bd29e945fb36`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:11:59,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:11:59,825::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:11:59,825::task::993::Storage.TaskManager.Task::(_decref) Task=`4e287400-f69f-45fb-a292-bd29e945fb36`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:12:04,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:12:04,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612479 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:12:04,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:12:04,246::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574349 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:12:14,247::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:12:14,258::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:12:14,258::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603802 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:12:14,268::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679014 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:12:14,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`850216e1-b03c-40d6-8141-6e2aebf5732a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:12:14,933::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:12:14,933::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603802', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679014', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:12:14,933::task::1191::Storage.TaskManager.Task::(prepare) Task=`850216e1-b03c-40d6-8141-6e2aebf5732a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603802', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679014', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:12:14,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`850216e1-b03c-40d6-8141-6e2aebf5732a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:12:14,933::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:12:14,934::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:12:14,934::task::993::Storage.TaskManager.Task::(_decref) Task=`850216e1-b03c-40d6-8141-6e2aebf5732a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:12:24,270::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:12:24,278::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:12:24,284::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799762 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:12:24,286::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00081071 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:12:30,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0d87418-36ee-4446-a016-225b5193d0c4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:12:30,047::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:12:30,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799762', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081071', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:12:30,072::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0d87418-36ee-4446-a016-225b5193d0c4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799762', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081071', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:12:30,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0d87418-36ee-4446-a016-225b5193d0c4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:12:30,072::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:12:30,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:12:30,072::task::993::Storage.TaskManager.Task::(_decref) Task=`e0d87418-36ee-4446-a016-225b5193d0c4`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:12:34,288::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:12:34,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616678 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:12:34,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:12:34,308::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621026 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:12:44,309::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:12:44,318::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:12:44,319::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702574 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:12:44,327::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662446 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:12:45,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`70c55ff5-2632-4730-8808-7c29b3bae6c8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:12:45,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:12:45,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702574', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662446', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:12:45,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`70c55ff5-2632-4730-8808-7c29b3bae6c8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702574', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662446', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:12:45,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`70c55ff5-2632-4730-8808-7c29b3bae6c8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:12:45,195::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:12:45,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:12:45,195::task::993::Storage.TaskManager.Task::(_decref) Task=`70c55ff5-2632-4730-8808-7c29b3bae6c8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:12:54,329::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:12:54,339::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000823002 s, 5.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:12:54,339::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:12:54,348::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749886 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:13:00,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`5307777b-9ddf-4c88-b0aa-aa2f7b43cfc7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:13:00,305::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:13:00,306::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823002', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749886', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:13:00,306::task::1191::Storage.TaskManager.Task::(prepare) Task=`5307777b-9ddf-4c88-b0aa-aa2f7b43cfc7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823002', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749886', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:13:00,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`5307777b-9ddf-4c88-b0aa-aa2f7b43cfc7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:13:00,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:13:00,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:13:00,307::task::993::Storage.TaskManager.Task::(_decref) Task=`5307777b-9ddf-4c88-b0aa-aa2f7b43cfc7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:13:04,348::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:13:04,358::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615081 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:04,359::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:04,368::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628217 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:13:14,369::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:13:14,378::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607662 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:14,379::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:14,388::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628898 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:13:15,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`73ffe2b9-eb39-48cd-9f06-a56fe3d5e705`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:13:15,412::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:13:15,412::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607662', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628898', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:13:15,413::task::1191::Storage.TaskManager.Task::(prepare) Task=`73ffe2b9-eb39-48cd-9f06-a56fe3d5e705`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607662', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628898', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:13:15,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`73ffe2b9-eb39-48cd-9f06-a56fe3d5e705`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:13:15,413::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:13:15,413::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:13:15,413::task::993::Storage.TaskManager.Task::(_decref) Task=`73ffe2b9-eb39-48cd-9f06-a56fe3d5e705`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:13:24,389::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:13:24,398::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00055715 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:24,399::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:24,409::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000833014 s, 4.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:13:30,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`eecc2413-c64e-4848-a69f-c3df3b321e4e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:13:30,564::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:13:30,564::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055715', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833014', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:13:30,565::task::1191::Storage.TaskManager.Task::(prepare) Task=`eecc2413-c64e-4848-a69f-c3df3b321e4e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055715', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833014', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:13:30,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`eecc2413-c64e-4848-a69f-c3df3b321e4e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:13:30,565::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:13:30,565::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:13:30,565::task::993::Storage.TaskManager.Task::(_decref) Task=`eecc2413-c64e-4848-a69f-c3df3b321e4e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:13:34,408::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:13:34,409::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:13:34,409::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:34,418::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-16::DEBUG::2014-08-12 16:13:34,420::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000571111 s, 3.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:34,420::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:13:34,421::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000571111 s, 3.6 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:13:34,422::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:13:34,423::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:13:34,424::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:13:34,423::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:13:34,431::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:13:34,432::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:13:34,433::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000647639 s, 3.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:34,434::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000647639 s, 3.2 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:13:34,435::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:13:34,435::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:13:34,435::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:13:34,436::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:13:34,437::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:13:34,438::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:13:34,438::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 16:13:34,438::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:13:34,438::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:13:34,439::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 16:13:34,440::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:13:34,700::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:13:34,701::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:13:34,702::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 16:13:34,703::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::INFO::2014-08-12 16:13:34,706::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-17::DEBUG::2014-08-12 16:13:34,706::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 16:13:34,706::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:13:34,707::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:13:34,709::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:34,708::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:13:34,717::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:13:34,891::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:13:34,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:34,900::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:13:34,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000530798 s, 7.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:34,903::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:13:34,904::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:13:34,906::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:13:34,906::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:13:34,906::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:13:34,907::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:35,074::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:35,074::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:35,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615614 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:13:44,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:13:44,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690799 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:45,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:45,092::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623282 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:13:45,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae2e975d-a3ee-4cf6-b89f-9ad884d8ee81`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:13:45,673::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:13:45,673::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690799', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623282', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:13:45,673::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae2e975d-a3ee-4cf6-b89f-9ad884d8ee81`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690799', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623282', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:13:45,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae2e975d-a3ee-4cf6-b89f-9ad884d8ee81`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:13:45,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:13:45,674::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:13:45,674::task::993::Storage.TaskManager.Task::(_decref) Task=`ae2e975d-a3ee-4cf6-b89f-9ad884d8ee81`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:13:54,916::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:13:54,924::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600755 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:13:55,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:13:55,104::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000827139 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:14:00,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6bd7b20-dad7-4fb0-b64e-4b4f03c70dc8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:14:00,788::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:14:00,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600755', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000827139', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:14:00,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6bd7b20-dad7-4fb0-b64e-4b4f03c70dc8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600755', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000827139', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:14:00,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6bd7b20-dad7-4fb0-b64e-4b4f03c70dc8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:14:00,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:14:00,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:14:00,789::task::993::Storage.TaskManager.Task::(_decref) Task=`a6bd7b20-dad7-4fb0-b64e-4b4f03c70dc8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:14:04,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:14:04,934::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000796728 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:14:05,107::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:14:05,115::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058632 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:14:14,935::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:14:14,944::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624749 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:14:15,118::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:14:15,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731364 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:14:15,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`27d95711-feb9-4c4d-be66-086b21730e4d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:14:15,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:14:15,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624749', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731364', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:14:15,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`27d95711-feb9-4c4d-be66-086b21730e4d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624749', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731364', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:14:15,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`27d95711-feb9-4c4d-be66-086b21730e4d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:14:15,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:14:15,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:14:15,908::task::993::Storage.TaskManager.Task::(_decref) Task=`27d95711-feb9-4c4d-be66-086b21730e4d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:14:24,946::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:14:24,955::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000743375 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:14:25,130::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:14:25,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000743991 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:14:31,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`10d9125b-fa27-4243-b6b6-0d63e38b940b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:14:31,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:14:31,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743375', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743991', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:14:31,021::task::1191::Storage.TaskManager.Task::(prepare) Task=`10d9125b-fa27-4243-b6b6-0d63e38b940b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743375', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743991', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:14:31,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`10d9125b-fa27-4243-b6b6-0d63e38b940b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:14:31,021::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:14:31,022::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:14:31,022::task::993::Storage.TaskManager.Task::(_decref) Task=`10d9125b-fa27-4243-b6b6-0d63e38b940b`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:14:34,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:14:34,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672559 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:14:35,141::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:14:35,149::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000758047 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:14:44,967::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:14:44,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747813 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:14:45,152::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:14:45,159::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072444 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:14:46,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4159dd7-e182-4f5a-b771-70295af0b67f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:14:46,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:14:46,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000747813', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072444', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:14:46,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4159dd7-e182-4f5a-b771-70295af0b67f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000747813', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072444', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:14:46,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4159dd7-e182-4f5a-b771-70295af0b67f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:14:46,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:14:46,131::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:14:46,131::task::993::Storage.TaskManager.Task::(_decref) Task=`b4159dd7-e182-4f5a-b771-70295af0b67f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:14:54,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:14:54,985::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650184 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:14:55,162::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:14:55,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000827923 s, 4.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:15:01,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f5d2d1f-6f96-4853-848d-df8bf1d29bef`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:15:01,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:15:01,237::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650184', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000827923', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:15:01,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f5d2d1f-6f96-4853-848d-df8bf1d29bef`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650184', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000827923', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:15:01,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f5d2d1f-6f96-4853-848d-df8bf1d29bef`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:15:01,238::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:15:01,238::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:15:01,238::task::993::Storage.TaskManager.Task::(_decref) Task=`2f5d2d1f-6f96-4853-848d-df8bf1d29bef`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:15:04,994::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:15:05,004::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000768379 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:15:05,174::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:15:05,183::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623415 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:15:15,007::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:15:15,015::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749495 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:15:15,186::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:15:15,193::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000891223 s, 4.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:15:16,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`65f1121b-10e6-4c01-b485-619a7f939df9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:15:16,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:15:16,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749495', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000891223', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:15:16,346::task::1191::Storage.TaskManager.Task::(prepare) Task=`65f1121b-10e6-4c01-b485-619a7f939df9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749495', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000891223', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:15:16,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`65f1121b-10e6-4c01-b485-619a7f939df9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:15:16,346::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:15:16,346::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:15:16,347::task::993::Storage.TaskManager.Task::(_decref) Task=`65f1121b-10e6-4c01-b485-619a7f939df9`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:15:25,017::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:15:25,025::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000584253 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:15:25,196::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:15:25,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751209 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:15:31,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`80b5aeba-7144-4f74-9522-f89d7645afb3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:15:31,454::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:15:31,454::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584253', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751209', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:15:31,454::task::1191::Storage.TaskManager.Task::(prepare) Task=`80b5aeba-7144-4f74-9522-f89d7645afb3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584253', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751209', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:15:31,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`80b5aeba-7144-4f74-9522-f89d7645afb3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:15:31,454::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:15:31,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:15:31,455::task::993::Storage.TaskManager.Task::(_decref) Task=`80b5aeba-7144-4f74-9522-f89d7645afb3`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:15:35,033::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:15:35,042::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000862512 s, 4.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:15:35,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:15:35,217::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695524 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:15:45,044::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:15:45,052::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719546 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:15:45,220::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:15:45,228::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643104 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:15:46,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`6825de4a-7639-44fb-acc8-869a2000a5c8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:15:46,560::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:15:46,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719546', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643104', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:15:46,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`6825de4a-7639-44fb-acc8-869a2000a5c8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719546', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643104', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:15:46,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`6825de4a-7639-44fb-acc8-869a2000a5c8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:15:46,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:15:46,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:15:46,561::task::993::Storage.TaskManager.Task::(_decref) Task=`6825de4a-7639-44fb-acc8-869a2000a5c8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:15:55,054::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:15:55,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756747 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:15:55,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:15:55,240::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751293 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:16:01,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`05c6f9c3-1063-49f8-be5b-e44fa42677ab`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:16:01,670::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:16:01,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756747', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751293', 'lastCheck': '6.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:16:01,671::task::1191::Storage.TaskManager.Task::(prepare) Task=`05c6f9c3-1063-49f8-be5b-e44fa42677ab`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756747', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751293', 'lastCheck': '6.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:16:01,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`05c6f9c3-1063-49f8-be5b-e44fa42677ab`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:16:01,671::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:16:01,671::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:16:01,671::task::993::Storage.TaskManager.Task::(_decref) Task=`05c6f9c3-1063-49f8-be5b-e44fa42677ab`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:16:05,068::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:16:05,077::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643453 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:16:05,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:16:05,252::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000520117 s, 7.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:16:15,079::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:16:15,087::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771755 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:16:15,255::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:16:15,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671373 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:16:16,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`a453f7a7-13df-4f1f-9a35-815ba559fddb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:16:16,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:16:16,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771755', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671373', 'lastCheck': '1.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:16:16,785::task::1191::Storage.TaskManager.Task::(prepare) Task=`a453f7a7-13df-4f1f-9a35-815ba559fddb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771755', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671373', 'lastCheck': '1.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:16:16,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`a453f7a7-13df-4f1f-9a35-815ba559fddb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:16:16,785::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:16:16,786::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:16:16,786::task::993::Storage.TaskManager.Task::(_decref) Task=`a453f7a7-13df-4f1f-9a35-815ba559fddb`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:16:25,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:16:25,097::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673187 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:16:25,267::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:16:25,274::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631207 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:16:31,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b465aa6-acbc-4189-bd6e-73fd2156f35a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:16:31,904::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:16:31,904::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673187', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631207', 'lastCheck': '6.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:16:31,904::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b465aa6-acbc-4189-bd6e-73fd2156f35a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673187', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631207', 'lastCheck': '6.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:16:31,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b465aa6-acbc-4189-bd6e-73fd2156f35a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:16:31,905::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:16:31,905::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:16:31,905::task::993::Storage.TaskManager.Task::(_decref) Task=`9b465aa6-acbc-4189-bd6e-73fd2156f35a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:16:35,099::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:16:35,108::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686174 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:16:35,277::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:16:35,284::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629992 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:16:45,110::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:16:45,118::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073192 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:16:45,288::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:16:45,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664848 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:16:47,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`f768d746-775a-4c80-96e3-d595e7f721f9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:16:47,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:16:47,011::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073192', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664848', 'lastCheck': '1.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:16:47,011::task::1191::Storage.TaskManager.Task::(prepare) Task=`f768d746-775a-4c80-96e3-d595e7f721f9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073192', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664848', 'lastCheck': '1.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:16:47,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`f768d746-775a-4c80-96e3-d595e7f721f9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:16:47,012::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:16:47,012::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:16:47,012::task::993::Storage.TaskManager.Task::(_decref) Task=`f768d746-775a-4c80-96e3-d595e7f721f9`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:16:55,120::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:16:55,128::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642249 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:16:55,300::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:16:55,311::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660264 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:17:02,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ebdbfeb-3b45-415d-9a2c-d20b60dabf7d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:17:02,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:17:02,117::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642249', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660264', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:17:02,118::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ebdbfeb-3b45-415d-9a2c-d20b60dabf7d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642249', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660264', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:17:02,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ebdbfeb-3b45-415d-9a2c-d20b60dabf7d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:17:02,118::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:17:02,118::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:17:02,118::task::993::Storage.TaskManager.Task::(_decref) Task=`3ebdbfeb-3b45-415d-9a2c-d20b60dabf7d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:17:05,130::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:17:05,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720175 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:17:05,314::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:17:05,322::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640474 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:17:15,140::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:17:15,149::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693665 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:17:15,326::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:17:15,333::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610802 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:17:17,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`646ae0a3-8dde-491c-aa87-08339c984364`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:17:17,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:17:17,232::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693665', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610802', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:17:17,232::task::1191::Storage.TaskManager.Task::(prepare) Task=`646ae0a3-8dde-491c-aa87-08339c984364`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693665', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610802', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:17:17,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`646ae0a3-8dde-491c-aa87-08339c984364`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:17:17,233::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:17:17,233::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:17:17,233::task::993::Storage.TaskManager.Task::(_decref) Task=`646ae0a3-8dde-491c-aa87-08339c984364`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:17:25,150::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:17:25,159::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586522 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:17:25,336::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:17:25,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802748 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:17:32,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9695129-95be-406a-9653-c1349e471764`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:17:32,341::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:17:32,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586522', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802748', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:17:32,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9695129-95be-406a-9653-c1349e471764`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586522', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802748', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:17:32,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9695129-95be-406a-9653-c1349e471764`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:17:32,341::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:17:32,342::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:17:32,342::task::993::Storage.TaskManager.Task::(_decref) Task=`f9695129-95be-406a-9653-c1349e471764`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:17:35,161::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:17:35,170::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079769 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:17:35,348::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:17:35,356::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006182 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:17:45,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:17:45,180::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609927 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:17:45,359::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:17:45,368::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611136 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:17:47,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`f56d8271-1457-4fcc-a996-81ba004080ce`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:17:47,448::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:17:47,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609927', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611136', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:17:47,448::task::1191::Storage.TaskManager.Task::(prepare) Task=`f56d8271-1457-4fcc-a996-81ba004080ce`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609927', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611136', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:17:47,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`f56d8271-1457-4fcc-a996-81ba004080ce`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:17:47,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:17:47,449::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:17:47,449::task::993::Storage.TaskManager.Task::(_decref) Task=`f56d8271-1457-4fcc-a996-81ba004080ce`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:17:55,182::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:17:55,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680241 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:17:55,371::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:17:55,380::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000831965 s, 4.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:18:02,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`cea1c693-b24d-4c34-83e3-835cb13639a3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:18:02,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:18:02,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680241', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000831965', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:18:02,559::task::1191::Storage.TaskManager.Task::(prepare) Task=`cea1c693-b24d-4c34-83e3-835cb13639a3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680241', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000831965', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:18:02,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`cea1c693-b24d-4c34-83e3-835cb13639a3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:18:02,559::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:18:02,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:18:02,559::task::993::Storage.TaskManager.Task::(_decref) Task=`cea1c693-b24d-4c34-83e3-835cb13639a3`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:18:05,199::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:18:05,208::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716852 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:05,383::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:05,391::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664441 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:18:15,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:18:15,218::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658413 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:15,394::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:15,402::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702585 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:18:17,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f750d53-b2c0-47cd-b65b-8ec3c1e99f1e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:18:17,669::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:18:17,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658413', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702585', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:18:17,670::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f750d53-b2c0-47cd-b65b-8ec3c1e99f1e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658413', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702585', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:18:17,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f750d53-b2c0-47cd-b65b-8ec3c1e99f1e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:18:17,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:18:17,670::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:18:17,670::task::993::Storage.TaskManager.Task::(_decref) Task=`1f750d53-b2c0-47cd-b65b-8ec3c1e99f1e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:18:25,220::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:18:25,228::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605133 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:25,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:25,414::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753739 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:18:32,823::task::595::Storage.TaskManager.Task::(_updateState) Task=`c80c4e0c-69fb-4450-a0cd-59ce4e3f6754`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:18:32,823::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:18:32,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605133', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753739', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:18:32,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`c80c4e0c-69fb-4450-a0cd-59ce4e3f6754`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605133', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753739', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:18:32,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`c80c4e0c-69fb-4450-a0cd-59ce4e3f6754`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:18:32,824::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:18:32,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:18:32,824::task::993::Storage.TaskManager.Task::(_decref) Task=`c80c4e0c-69fb-4450-a0cd-59ce4e3f6754`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:18:35,230::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:18:35,230::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:18:35,231::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:18:35,239::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000608075 s, 3.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:18:35,239::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000608075 s, 3.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:18:35,239::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:18:35,239::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:18:35,240::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:18:35,240::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:18:35,240::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:18:35,240::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:18:35,241::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:18:35,241::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:18:35,241::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:35,425::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:18:35,426::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:18:35,426::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:35,434::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000636507 s, 3.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:35,435::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000636507 s, 3.2 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:18:35,435::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:18:35,435::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:18:35,435::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:18:35,435::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 16:18:35,504::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:18:35,504::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:18:35,505::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 16:18:35,506::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:18:35,508::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 16:18:35,509::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:18:35,510::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-17::DEBUG::2014-08-12 16:18:35,510::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::INFO::2014-08-12 16:18:35,511::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:18:35,513::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:18:35,514::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:35,522::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:18:35,523::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:18:35,682::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:18:35,683::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:18:35,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000507888 s, 8.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:35,704::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:35,705::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:18:35,705::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:18:35,706::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:18:35,706::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:18:35,706::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:18:35,707::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:35,873::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:35,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:35,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000523546 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:18:45,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:18:45,701::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064026 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:45,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:45,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979757 s, 4.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:18:47,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`16bf5eb7-3c08-4324-a87a-233ae496aea5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:18:47,948::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:18:47,948::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064026', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000979757', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:18:47,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`16bf5eb7-3c08-4324-a87a-233ae496aea5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064026', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000979757', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:18:47,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`16bf5eb7-3c08-4324-a87a-233ae496aea5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:18:47,949::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:18:47,949::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:18:47,949::task::993::Storage.TaskManager.Task::(_decref) Task=`16bf5eb7-3c08-4324-a87a-233ae496aea5`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:18:55,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:18:55,711::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626668 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:18:55,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:18:55,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671014 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:19:03,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`343fc6b0-c4a8-423b-8148-a8a88b8205ed`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:19:03,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:19:03,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626668', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671014', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:19:03,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`343fc6b0-c4a8-423b-8148-a8a88b8205ed`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626668', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671014', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:19:03,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`343fc6b0-c4a8-423b-8148-a8a88b8205ed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:19:03,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:19:03,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:19:03,064::task::993::Storage.TaskManager.Task::(_decref) Task=`343fc6b0-c4a8-423b-8148-a8a88b8205ed`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:19:05,726::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:19:05,735::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727015 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:19:05,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:19:05,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629272 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:19:15,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:19:15,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797566 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:19:15,917::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:19:15,924::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643011 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:19:18,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b60aeb9-f32f-4ffd-a720-538cbc24b0a7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:19:18,183::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:19:18,183::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797566', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643011', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:19:18,183::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b60aeb9-f32f-4ffd-a720-538cbc24b0a7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797566', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643011', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:19:18,183::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b60aeb9-f32f-4ffd-a720-538cbc24b0a7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:19:18,183::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:19:18,184::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:19:18,184::task::993::Storage.TaskManager.Task::(_decref) Task=`3b60aeb9-f32f-4ffd-a720-538cbc24b0a7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:19:25,747::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:19:25,755::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641424 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:19:25,927::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:19:25,936::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000776711 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:19:33,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`84c3855b-b811-4a76-9953-ea1b84723210`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:19:33,289::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:19:33,289::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641424', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000776711', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:19:33,289::task::1191::Storage.TaskManager.Task::(prepare) Task=`84c3855b-b811-4a76-9953-ea1b84723210`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641424', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000776711', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:19:33,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`84c3855b-b811-4a76-9953-ea1b84723210`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:19:33,290::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:19:33,290::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:19:33,290::task::993::Storage.TaskManager.Task::(_decref) Task=`84c3855b-b811-4a76-9953-ea1b84723210`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:19:35,778::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:19:35,786::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683701 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:19:35,939::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:19:35,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061654 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:19:45,787::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:19:45,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740079 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:19:45,951::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:19:45,958::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586443 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:19:48,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca265c9-2310-4b30-a42e-c999688a0c58`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:19:48,395::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:19:48,395::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740079', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586443', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:19:48,396::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ca265c9-2310-4b30-a42e-c999688a0c58`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740079', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586443', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:19:48,396::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca265c9-2310-4b30-a42e-c999688a0c58`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:19:48,396::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:19:48,396::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:19:48,396::task::993::Storage.TaskManager.Task::(_decref) Task=`2ca265c9-2310-4b30-a42e-c999688a0c58`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:19:55,797::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:19:55,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625934 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:19:55,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:19:55,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774275 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:20:03,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`b95c8411-bf44-48e0-9f1c-b79a70a74b01`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:20:03,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:20:03,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625934', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774275', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:20:03,515::task::1191::Storage.TaskManager.Task::(prepare) Task=`b95c8411-bf44-48e0-9f1c-b79a70a74b01`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625934', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774275', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:20:03,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`b95c8411-bf44-48e0-9f1c-b79a70a74b01`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:20:03,515::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:20:03,515::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:20:03,516::task::993::Storage.TaskManager.Task::(_decref) Task=`b95c8411-bf44-48e0-9f1c-b79a70a74b01`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:20:05,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:20:05,832::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586285 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:20:05,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:20:05,980::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000522582 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:20:15,833::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:20:15,842::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000865646 s, 4.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:20:15,983::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:20:15,991::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690433 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:20:18,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`35293a19-8c5a-472a-9cee-dd324378dd78`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:20:18,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:20:18,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000865646', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690433', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:20:18,623::task::1191::Storage.TaskManager.Task::(prepare) Task=`35293a19-8c5a-472a-9cee-dd324378dd78`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000865646', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690433', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:20:18,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`35293a19-8c5a-472a-9cee-dd324378dd78`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:20:18,623::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:20:18,624::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:20:18,624::task::993::Storage.TaskManager.Task::(_decref) Task=`35293a19-8c5a-472a-9cee-dd324378dd78`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:20:25,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:20:25,852::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602466 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:20:25,994::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:20:26,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766701 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:20:33,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5b395a0-bdf6-4f1f-81ee-5c2a12549437`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:20:33,739::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:20:33,739::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602466', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766701', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:20:33,740::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5b395a0-bdf6-4f1f-81ee-5c2a12549437`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602466', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766701', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:20:33,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5b395a0-bdf6-4f1f-81ee-5c2a12549437`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:20:33,740::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:20:33,740::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:20:33,740::task::993::Storage.TaskManager.Task::(_decref) Task=`d5b395a0-bdf6-4f1f-81ee-5c2a12549437`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:20:35,863::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:20:35,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669799 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:20:36,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:20:36,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0017389 s, 2.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:20:45,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:20:45,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00083369 s, 4.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:20:46,018::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:20:46,025::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735459 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:20:48,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fa600bd-31c1-4da2-9648-e06129323970`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:20:48,851::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:20:48,851::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00083369', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735459', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:20:48,851::task::1191::Storage.TaskManager.Task::(prepare) Task=`2fa600bd-31c1-4da2-9648-e06129323970`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00083369', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735459', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:20:48,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fa600bd-31c1-4da2-9648-e06129323970`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:20:48,852::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:20:48,852::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:20:48,852::task::993::Storage.TaskManager.Task::(_decref) Task=`2fa600bd-31c1-4da2-9648-e06129323970`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:20:55,883::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:20:55,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000767247 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:20:56,027::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:20:56,036::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00151603 s, 2.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:21:03,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`886cdb42-f67c-4891-a5b1-130a30205e8e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:21:03,966::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:21:03,966::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000767247', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00151603', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:21:03,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`886cdb42-f67c-4891-a5b1-130a30205e8e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000767247', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00151603', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:21:03,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`886cdb42-f67c-4891-a5b1-130a30205e8e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:21:03,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:21:03,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:21:03,967::task::993::Storage.TaskManager.Task::(_decref) Task=`886cdb42-f67c-4891-a5b1-130a30205e8e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:21:05,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:21:05,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629606 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:21:06,046::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:21:06,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0018732 s, 2.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:21:15,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:21:15,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00084068 s, 4.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:21:16,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:21:16,065::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749538 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:21:19,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1fc39ae-0807-4449-b93d-24c81f3070ef`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:21:19,083::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:21:19,084::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084068', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749538', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:21:19,084::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1fc39ae-0807-4449-b93d-24c81f3070ef`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084068', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749538', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:21:19,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1fc39ae-0807-4449-b93d-24c81f3070ef`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:21:19,084::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:21:19,084::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:21:19,085::task::993::Storage.TaskManager.Task::(_decref) Task=`b1fc39ae-0807-4449-b93d-24c81f3070ef`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:21:25,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:21:25,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000938911 s, 4.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:21:26,068::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:21:26,077::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00158942 s, 2.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:21:34,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`3274cbed-61e3-4e0d-a041-e30b79669b18`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:21:34,191::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:21:34,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000938911', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00158942', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:21:34,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`3274cbed-61e3-4e0d-a041-e30b79669b18`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000938911', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00158942', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:21:34,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`3274cbed-61e3-4e0d-a041-e30b79669b18`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:21:34,191::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:21:34,191::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:21:34,192::task::993::Storage.TaskManager.Task::(_decref) Task=`3274cbed-61e3-4e0d-a041-e30b79669b18`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:21:35,934::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:21:35,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730646 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:21:36,081::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:21:36,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000910612 s, 4.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:21:45,944::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:21:45,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000823679 s, 5.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:21:46,092::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:21:46,100::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611396 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:21:49,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8262862-fd57-48ec-9124-d8d5f829174c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:21:49,297::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:21:49,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823679', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611396', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:21:49,298::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8262862-fd57-48ec-9124-d8d5f829174c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823679', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611396', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:21:49,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8262862-fd57-48ec-9124-d8d5f829174c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:21:49,298::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:21:49,298::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:21:49,298::task::993::Storage.TaskManager.Task::(_decref) Task=`c8262862-fd57-48ec-9124-d8d5f829174c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:21:55,955::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:21:55,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640734 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:21:56,103::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:21:56,112::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00129739 s, 3.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:22:04,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d4fd643-8500-4431-a2d2-458447d8b54d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:22:04,413::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:22:04,413::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640734', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129739', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:22:04,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d4fd643-8500-4431-a2d2-458447d8b54d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640734', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129739', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:22:04,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d4fd643-8500-4431-a2d2-458447d8b54d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:22:04,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:22:04,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:22:04,414::task::993::Storage.TaskManager.Task::(_decref) Task=`7d4fd643-8500-4431-a2d2-458447d8b54d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:22:05,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:22:05,973::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00126486 s, 3.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:22:06,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:22:06,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104408 s, 3.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:22:15,974::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:22:15,985::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00228937 s, 1.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:22:16,128::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:22:16,136::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656968 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:22:19,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`af2666cb-352e-4d89-99f6-17cccdda5c81`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:22:19,585::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:22:19,585::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00228937', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656968', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:22:19,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`af2666cb-352e-4d89-99f6-17cccdda5c81`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00228937', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656968', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:22:19,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`af2666cb-352e-4d89-99f6-17cccdda5c81`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:22:19,586::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:22:19,586::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:22:19,586::task::993::Storage.TaskManager.Task::(_decref) Task=`af2666cb-352e-4d89-99f6-17cccdda5c81`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:22:25,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:22:25,995::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664846 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:22:26,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:22:26,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799813 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:22:34,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`274d7df8-b97f-4e03-ada8-2ab36fe308b8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:22:34,715::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:22:34,715::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664846', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799813', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:22:34,716::task::1191::Storage.TaskManager.Task::(prepare) Task=`274d7df8-b97f-4e03-ada8-2ab36fe308b8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664846', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799813', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:22:34,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`274d7df8-b97f-4e03-ada8-2ab36fe308b8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:22:34,716::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:22:34,716::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:22:34,716::task::993::Storage.TaskManager.Task::(_decref) Task=`274d7df8-b97f-4e03-ada8-2ab36fe308b8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:22:35,996::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:22:36,005::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682499 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:22:36,150::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:22:36,158::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000768723 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:22:46,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:22:46,015::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729393 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:22:46,160::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:22:46,169::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680641 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:22:49,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f3388e0-4bef-43ff-94e1-b56a7c21c168`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:22:49,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:22:49,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729393', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680641', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:22:49,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f3388e0-4bef-43ff-94e1-b56a7c21c168`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729393', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680641', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:22:49,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f3388e0-4bef-43ff-94e1-b56a7c21c168`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:22:49,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:22:49,873::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:22:49,873::task::993::Storage.TaskManager.Task::(_decref) Task=`4f3388e0-4bef-43ff-94e1-b56a7c21c168`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:22:56,017::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:22:56,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730944 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:22:56,172::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:22:56,179::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106821 s, 3.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:23:04,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc01b9e6-3b34-40be-83fc-badfc35eb531`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:23:04,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:23:04,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730944', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106821', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:23:04,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc01b9e6-3b34-40be-83fc-badfc35eb531`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730944', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106821', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:23:04,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc01b9e6-3b34-40be-83fc-badfc35eb531`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:23:04,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:23:04,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:23:04,988::task::993::Storage.TaskManager.Task::(_decref) Task=`cc01b9e6-3b34-40be-83fc-badfc35eb531`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:23:06,026::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:23:06,036::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00268309 s, 1.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:06,182::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:06,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598371 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:23:16,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:23:16,047::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00095648 s, 4.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:16,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:16,201::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000827442 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:23:20,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`04453886-024a-4e39-98ca-7962cee7205f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:23:20,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:23:20,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00095648', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000827442', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:23:20,099::task::1191::Storage.TaskManager.Task::(prepare) Task=`04453886-024a-4e39-98ca-7962cee7205f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00095648', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000827442', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:23:20,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`04453886-024a-4e39-98ca-7962cee7205f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:23:20,100::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:23:20,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:23:20,100::task::993::Storage.TaskManager.Task::(_decref) Task=`04453886-024a-4e39-98ca-7962cee7205f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:23:26,049::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:23:26,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00211414 s, 1.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:26,204::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:26,212::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068876 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:23:35,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`2588a760-5e78-41a2-bfe6-ccdd8e3c0cc4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:23:35,220::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:23:35,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00211414', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068876', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:23:35,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`2588a760-5e78-41a2-bfe6-ccdd8e3c0cc4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00211414', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068876', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:23:35,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`2588a760-5e78-41a2-bfe6-ccdd8e3c0cc4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:23:35,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:23:35,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:23:35,221::task::993::Storage.TaskManager.Task::(_decref) Task=`2588a760-5e78-41a2-bfe6-ccdd8e3c0cc4`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:23:36,060::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:23:36,060::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:23:36,060::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:23:36,072::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00360595 s, 568 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:23:36,072::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00360595 s, 568 kB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:23:36,072::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:23:36,072::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:23:36,072::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:23:36,073::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:23:36,073::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:23:36,073::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:23:36,073::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:23:36,074::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:23:36,074::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:36,215::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:23:36,216::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:23:36,216::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:36,225::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000603297 s, 3.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:36,226::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000603297 s, 3.4 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:23:36,226::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:23:36,226::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:23:36,226::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:23:36,226::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 16:23:36,349::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:23:36,350::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:23:36,351::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 16:23:36,352::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:23:36,354::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 16:23:36,355::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:23:36,356::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-17::DEBUG::2014-08-12 16:23:36,356::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::INFO::2014-08-12 16:23:36,357::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:23:36,358::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:36,359::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:23:36,368::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:23:36,368::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:23:36,538::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:23:36,539::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:23:36,548::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000767805 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:36,561::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:36,562::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:23:36,562::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:23:36,563::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:23:36,563::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:23:36,563::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:23:36,564::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:36,753::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:36,753::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:36,763::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00238208 s, 1.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:23:46,549::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:23:46,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00372699 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:46,766::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:46,776::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00365478 s, 1.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:23:50,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`84cdbed5-fcc8-4ca9-b7cc-9814901d5a8b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:23:50,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:23:50,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00372699', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00365478', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:23:50,354::task::1191::Storage.TaskManager.Task::(prepare) Task=`84cdbed5-fcc8-4ca9-b7cc-9814901d5a8b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00372699', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00365478', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:23:50,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`84cdbed5-fcc8-4ca9-b7cc-9814901d5a8b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:23:50,354::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:23:50,355::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:23:50,355::task::993::Storage.TaskManager.Task::(_decref) Task=`84cdbed5-fcc8-4ca9-b7cc-9814901d5a8b`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:23:56,562::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:23:56,571::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00204062 s, 2.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:23:56,779::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:23:56,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00242791 s, 1.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:24:05,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`b12564ac-5c04-4e42-81ae-7f4a2042f3b9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:24:05,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:24:05,512::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00204062', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00242791', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:24:05,513::task::1191::Storage.TaskManager.Task::(prepare) Task=`b12564ac-5c04-4e42-81ae-7f4a2042f3b9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00204062', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00242791', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:24:05,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`b12564ac-5c04-4e42-81ae-7f4a2042f3b9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:24:05,513::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:24:05,513::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:24:05,513::task::993::Storage.TaskManager.Task::(_decref) Task=`b12564ac-5c04-4e42-81ae-7f4a2042f3b9`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:24:06,573::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:24:06,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000848394 s, 4.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:24:06,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:24:06,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061022 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:24:16,583::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:24:16,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681942 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:24:16,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:24:16,820::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644716 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:24:20,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`22a4848a-761c-45f7-a000-2891e4003fc7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:24:20,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:24:20,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681942', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644716', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:24:20,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`22a4848a-761c-45f7-a000-2891e4003fc7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681942', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644716', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:24:20,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`22a4848a-761c-45f7-a000-2891e4003fc7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:24:20,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:24:20,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:24:20,622::task::993::Storage.TaskManager.Task::(_decref) Task=`22a4848a-761c-45f7-a000-2891e4003fc7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:24:26,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:24:26,603::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00142129 s, 2.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:24:26,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:24:26,832::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000867592 s, 4.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:24:35,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`03153249-e4d9-47fd-8a8b-49a6cbf64ac1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:24:35,762::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:24:35,762::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142129', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867592', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:24:35,762::task::1191::Storage.TaskManager.Task::(prepare) Task=`03153249-e4d9-47fd-8a8b-49a6cbf64ac1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142129', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867592', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:24:35,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`03153249-e4d9-47fd-8a8b-49a6cbf64ac1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:24:35,762::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:24:35,762::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:24:35,763::task::993::Storage.TaskManager.Task::(_decref) Task=`03153249-e4d9-47fd-8a8b-49a6cbf64ac1`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:24:36,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:24:36,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00305624 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:24:36,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:24:36,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0031733 s, 1.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:24:46,616::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:24:46,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00500496 s, 818 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:24:46,849::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:24:46,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00528724 s, 775 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:24:50,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8ed79ce-27d2-4501-bb51-aa1525214e81`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:24:50,914::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:24:50,915::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00500496', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00528724', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:24:50,915::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8ed79ce-27d2-4501-bb51-aa1525214e81`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00500496', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00528724', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:24:50,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8ed79ce-27d2-4501-bb51-aa1525214e81`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:24:50,915::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:24:50,915::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:24:50,915::task::993::Storage.TaskManager.Task::(_decref) Task=`b8ed79ce-27d2-4501-bb51-aa1525214e81`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:24:56,631::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:24:56,641::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00266917 s, 1.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:24:56,865::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:24:56,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00313752 s, 1.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:25:06,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb604a6-06d2-45cb-a652-0d895a07c1e1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:25:06,073::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:25:06,073::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00266917', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00313752', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:25:06,073::task::1191::Storage.TaskManager.Task::(prepare) Task=`afb604a6-06d2-45cb-a652-0d895a07c1e1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00266917', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00313752', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:25:06,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb604a6-06d2-45cb-a652-0d895a07c1e1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:25:06,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:25:06,074::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:25:06,074::task::993::Storage.TaskManager.Task::(_decref) Task=`afb604a6-06d2-45cb-a652-0d895a07c1e1`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:25:06,643::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:25:06,655::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00396353 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:25:06,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:25:06,889::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00358469 s, 1.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:25:16,669::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:25:16,683::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00504451 s, 812 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:25:16,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:25:16,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00572351 s, 716 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:25:21,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`c97146d7-fe0b-4524-97d9-4dd18033e3e1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:25:21,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:25:21,235::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00504451', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00572351', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:25:21,235::task::1191::Storage.TaskManager.Task::(prepare) Task=`c97146d7-fe0b-4524-97d9-4dd18033e3e1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00504451', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00572351', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:25:21,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`c97146d7-fe0b-4524-97d9-4dd18033e3e1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:25:21,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:25:21,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:25:21,236::task::993::Storage.TaskManager.Task::(_decref) Task=`c97146d7-fe0b-4524-97d9-4dd18033e3e1`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:25:26,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:25:26,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00507457 s, 807 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:25:26,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:25:26,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00539999 s, 759 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:25:36,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`c64ff874-123f-4316-a4c6-1caefc57056e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:25:36,404::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:25:36,404::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00507457', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00539999', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:25:36,404::task::1191::Storage.TaskManager.Task::(prepare) Task=`c64ff874-123f-4316-a4c6-1caefc57056e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00507457', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00539999', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:25:36,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`c64ff874-123f-4316-a4c6-1caefc57056e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:25:36,404::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:25:36,405::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:25:36,405::task::993::Storage.TaskManager.Task::(_decref) Task=`c64ff874-123f-4316-a4c6-1caefc57056e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:25:36,698::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:25:36,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00448306 s, 914 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:25:36,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:25:36,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00692202 s, 592 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:25:46,712::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:25:46,725::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00566894 s, 723 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:25:46,944::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:25:46,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00348271 s, 1.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:25:51,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`cde1bd17-adea-400c-b932-66b43ae150cf`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:25:51,550::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:25:51,550::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00566894', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00348271', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:25:51,551::task::1191::Storage.TaskManager.Task::(prepare) Task=`cde1bd17-adea-400c-b932-66b43ae150cf`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00566894', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00348271', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:25:51,551::task::595::Storage.TaskManager.Task::(_updateState) Task=`cde1bd17-adea-400c-b932-66b43ae150cf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:25:51,551::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:25:51,551::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:25:51,551::task::993::Storage.TaskManager.Task::(_decref) Task=`cde1bd17-adea-400c-b932-66b43ae150cf`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:25:56,727::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:25:56,736::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00244946 s, 1.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:25:56,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:25:56,967::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00274542 s, 1.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:26:06,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`8adaa056-c2fc-4f65-b2f7-dcf7c6da1f81`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:26:06,702::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:26:06,702::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00244946', 'lastCheck': '10.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00274542', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:26:06,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`8adaa056-c2fc-4f65-b2f7-dcf7c6da1f81`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00244946', 'lastCheck': '10.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00274542', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:26:06,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`8adaa056-c2fc-4f65-b2f7-dcf7c6da1f81`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:26:06,703::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:26:06,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:26:06,703::task::993::Storage.TaskManager.Task::(_decref) Task=`8adaa056-c2fc-4f65-b2f7-dcf7c6da1f81`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:26:06,738::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:26:06,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00414603 s, 988 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:26:06,970::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:26:06,982::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00424231 s, 966 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:26:16,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:26:16,765::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00518894 s, 789 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:26:16,985::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:26:16,998::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00531543 s, 771 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:26:21,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dfcba28-06bb-4827-a133-533327d21c7f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:26:21,852::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:26:21,853::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00518894', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00531543', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:26:21,853::task::1191::Storage.TaskManager.Task::(prepare) Task=`2dfcba28-06bb-4827-a133-533327d21c7f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00518894', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00531543', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:26:21,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dfcba28-06bb-4827-a133-533327d21c7f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:26:21,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:26:21,853::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:26:21,853::task::993::Storage.TaskManager.Task::(_decref) Task=`2dfcba28-06bb-4827-a133-533327d21c7f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:26:26,767::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:26:26,778::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00417221 s, 982 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:26:27,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:26:27,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00456831 s, 897 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:26:36,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:26:36,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00774418 s, 529 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:26:37,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`0511a75c-37ed-4c8e-82a1-5b45d2f8bf6d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:26:37,009::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:26:37,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00774418', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00456831', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:26:37,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`0511a75c-37ed-4c8e-82a1-5b45d2f8bf6d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00774418', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00456831', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:26:37,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`0511a75c-37ed-4c8e-82a1-5b45d2f8bf6d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:26:37,010::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:26:37,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:26:37,011::task::993::Storage.TaskManager.Task::(_decref) Task=`0511a75c-37ed-4c8e-82a1-5b45d2f8bf6d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:26:37,017::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:26:37,030::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00553951 s, 739 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:26:46,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:26:46,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00415388 s, 986 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:26:47,033::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:26:47,044::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00417269 s, 982 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:26:52,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`73d412fb-f62f-480f-ae5d-8bf6dffdbb5f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:26:52,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:26:52,170::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00415388', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00417269', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:26:52,170::task::1191::Storage.TaskManager.Task::(prepare) Task=`73d412fb-f62f-480f-ae5d-8bf6dffdbb5f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00415388', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00417269', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:26:52,170::task::595::Storage.TaskManager.Task::(_updateState) Task=`73d412fb-f62f-480f-ae5d-8bf6dffdbb5f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:26:52,170::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:26:52,170::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:26:52,171::task::993::Storage.TaskManager.Task::(_decref) Task=`73d412fb-f62f-480f-ae5d-8bf6dffdbb5f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:26:56,812::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:26:56,820::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632593 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:26:57,047::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:26:57,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785798 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:27:06,821::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:27:06,830::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637117 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:27:07,059::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:27:07,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611067 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:27:07,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9126755-1f89-4cd1-bd1a-994504b8bcf4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:27:07,331::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:27:07,331::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637117', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611067', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:27:07,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9126755-1f89-4cd1-bd1a-994504b8bcf4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637117', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611067', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:27:07,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9126755-1f89-4cd1-bd1a-994504b8bcf4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:27:07,332::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:27:07,332::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:27:07,332::task::993::Storage.TaskManager.Task::(_decref) Task=`c9126755-1f89-4cd1-bd1a-994504b8bcf4`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:27:16,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:27:16,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599131 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:27:17,070::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:27:17,079::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000795904 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:27:22,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`22096bb6-760d-4b17-8a31-17e0adadf3e8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:27:22,445::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:27:22,446::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599131', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795904', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:27:22,446::task::1191::Storage.TaskManager.Task::(prepare) Task=`22096bb6-760d-4b17-8a31-17e0adadf3e8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599131', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795904', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:27:22,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`22096bb6-760d-4b17-8a31-17e0adadf3e8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:27:22,447::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:27:22,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:27:22,448::task::993::Storage.TaskManager.Task::(_decref) Task=`22096bb6-760d-4b17-8a31-17e0adadf3e8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:27:26,842::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:27:26,849::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000551921 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:27:27,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:27:27,091::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567813 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:27:36,851::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:27:36,860::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000898225 s, 4.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:27:37,094::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:27:37,102::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080671 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:27:37,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`25ad24fd-1698-49cf-b5d4-62fda4ea81f9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:27:37,583::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:27:37,583::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000898225', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080671', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:27:37,583::task::1191::Storage.TaskManager.Task::(prepare) Task=`25ad24fd-1698-49cf-b5d4-62fda4ea81f9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000898225', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00080671', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:27:37,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`25ad24fd-1698-49cf-b5d4-62fda4ea81f9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:27:37,584::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:27:37,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:27:37,584::task::993::Storage.TaskManager.Task::(_decref) Task=`25ad24fd-1698-49cf-b5d4-62fda4ea81f9`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:27:46,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:27:46,874::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0043524 s, 941 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:27:47,106::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:27:47,117::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00440409 s, 930 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:27:52,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b80a560-a618-491c-bc84-051eee3b7765`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:27:52,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:27:52,744::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0043524', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00440409', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:27:52,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b80a560-a618-491c-bc84-051eee3b7765`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0043524', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00440409', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:27:52,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b80a560-a618-491c-bc84-051eee3b7765`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:27:52,750::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:27:52,751::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:27:52,752::task::993::Storage.TaskManager.Task::(_decref) Task=`7b80a560-a618-491c-bc84-051eee3b7765`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:27:56,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:27:56,888::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00500474 s, 818 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:27:57,120::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:27:57,133::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00520531 s, 787 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:28:06,889::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:28:06,905::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0079065 s, 518 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:07,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:07,148::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0042284 s, 969 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:28:07,920::task::595::Storage.TaskManager.Task::(_updateState) Task=`5261398f-2a45-40ea-81fd-ff2fc07e5ca4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:28:07,921::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:28:07,921::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0079065', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0042284', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:28:07,921::task::1191::Storage.TaskManager.Task::(prepare) Task=`5261398f-2a45-40ea-81fd-ff2fc07e5ca4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0079065', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0042284', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:28:07,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`5261398f-2a45-40ea-81fd-ff2fc07e5ca4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:28:07,922::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:28:07,922::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:28:07,922::task::993::Storage.TaskManager.Task::(_decref) Task=`5261398f-2a45-40ea-81fd-ff2fc07e5ca4`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:28:16,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:28:16,918::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00405872 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:17,151::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:17,162::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00417845 s, 980 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:28:23,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`1234a095-8d10-462b-bde3-91eb1dcf6483`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:28:23,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:28:23,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00405872', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00417845', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:28:23,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`1234a095-8d10-462b-bde3-91eb1dcf6483`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00405872', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00417845', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:28:23,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`1234a095-8d10-462b-bde3-91eb1dcf6483`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:28:23,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:28:23,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:28:23,083::task::993::Storage.TaskManager.Task::(_decref) Task=`1234a095-8d10-462b-bde3-91eb1dcf6483`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:28:26,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:28:26,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00452745 s, 905 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:27,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:27,178::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00496389 s, 825 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:28:36,933::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:28:36,935::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:28:36,938::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:28:36,950::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00374822 s, 546 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:28:36,950::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00374822 s, 546 kB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:28:36,951::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:28:36,951::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:28:36,951::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:28:36,952::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:28:36,952::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:28:36,952::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:28:36,952::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:28:36,953::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:28:36,953::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:37,181::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:28:37,181::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:28:37,182::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:37,193::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0036813 s, 556 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:37,193::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0036813 s, 556 kB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:28:37,194::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:28:37,194::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:28:37,194::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:28:37,194::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 16:28:37,384::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:28:37,384::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:28:37,385::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 16:28:37,386::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:28:37,388::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 16:28:37,389::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:28:37,390::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:28:37,391::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:28:37,391::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:28:37,393::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:37,393::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:28:37,403::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:28:37,403::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:28:37,632::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:28:37,632::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:28:37,645::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0043349 s, 945 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:37,780::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:37,780::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:28:37,781::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:28:37,781::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:28:37,782::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:28:37,782::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:28:37,782::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:38,013::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:38,013::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:38,026::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00458298 s, 894 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:28:38,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`060423fd-cd44-4fdb-a85b-eb8f3ac3bf1c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:28:38,301::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:28:38,301::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0043349', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00458298', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:28:38,301::task::1191::Storage.TaskManager.Task::(prepare) Task=`060423fd-cd44-4fdb-a85b-eb8f3ac3bf1c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0043349', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00458298', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:28:38,301::task::595::Storage.TaskManager.Task::(_updateState) Task=`060423fd-cd44-4fdb-a85b-eb8f3ac3bf1c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:28:38,301::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:28:38,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:28:38,302::task::993::Storage.TaskManager.Task::(_decref) Task=`060423fd-cd44-4fdb-a85b-eb8f3ac3bf1c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:28:47,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:48,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:28:49,489::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 1.83428 s, 2.2 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:49,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 1.45815 s, 2.8 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:28:53,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d9663db-e17a-4736-93ea-6750c16d218a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:28:53,453::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:28:53,453::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '1.83428', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '1.45815', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:28:53,453::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d9663db-e17a-4736-93ea-6750c16d218a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '1.83428', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '1.45815', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:28:53,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d9663db-e17a-4736-93ea-6750c16d218a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:28:53,454::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:28:53,454::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:28:53,454::task::993::Storage.TaskManager.Task::(_decref) Task=`8d9663db-e17a-4736-93ea-6750c16d218a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:28:59,491::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:28:59,499::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:28:59,506::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00434615 s, 942 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:28:59,510::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00429318 s, 954 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:29:08,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f220ff8-bd89-4181-b458-2f75d69ad5d0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:29:08,628::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:29:08,628::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00434615', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00429318', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:29:08,628::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f220ff8-bd89-4181-b458-2f75d69ad5d0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00434615', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00429318', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:29:08,628::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f220ff8-bd89-4181-b458-2f75d69ad5d0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:29:08,629::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:29:08,629::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:29:08,629::task::993::Storage.TaskManager.Task::(_decref) Task=`4f220ff8-bd89-4181-b458-2f75d69ad5d0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:29:09,507::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:29:09,516::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:29:09,523::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00300122 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:29:09,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00298597 s, 1.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:29:19,525::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:29:19,533::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:29:19,540::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00441097 s, 929 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:29:19,544::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00439861 s, 931 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:29:23,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`be2f9643-39a9-4b6d-addb-cc74c5dfd568`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:29:23,779::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:29:23,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00441097', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00439861', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:29:23,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`be2f9643-39a9-4b6d-addb-cc74c5dfd568`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00441097', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00439861', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:29:23,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`be2f9643-39a9-4b6d-addb-cc74c5dfd568`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:29:23,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:29:23,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:29:23,780::task::993::Storage.TaskManager.Task::(_decref) Task=`be2f9643-39a9-4b6d-addb-cc74c5dfd568`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:29:29,542::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:29:29,550::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:29:29,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00275558 s, 1.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:29:29,562::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00265207 s, 1.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:29:38,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fd57fa9-48d0-4d0d-a6cb-ba96a328aa88`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:29:38,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:29:38,939::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00275558', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00265207', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:29:38,939::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fd57fa9-48d0-4d0d-a6cb-ba96a328aa88`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00275558', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00265207', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:29:38,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fd57fa9-48d0-4d0d-a6cb-ba96a328aa88`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:29:38,939::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:29:38,940::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:29:38,940::task::993::Storage.TaskManager.Task::(_decref) Task=`9fd57fa9-48d0-4d0d-a6cb-ba96a328aa88`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:29:39,561::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:29:39,570::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:29:39,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00505628 s, 810 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:29:39,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00496737 s, 825 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:29:49,579::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:29:49,587::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:29:49,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0048228 s, 849 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:29:49,599::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00471475 s, 869 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:29:54,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`001f29d7-97be-4712-a14a-0ffc4f099782`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:29:54,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:29:54,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0048228', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00471475', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:29:54,099::task::1191::Storage.TaskManager.Task::(prepare) Task=`001f29d7-97be-4712-a14a-0ffc4f099782`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0048228', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00471475', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:29:54,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`001f29d7-97be-4712-a14a-0ffc4f099782`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:29:54,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:29:54,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:29:54,100::task::993::Storage.TaskManager.Task::(_decref) Task=`001f29d7-97be-4712-a14a-0ffc4f099782`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:29:59,596::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:29:59,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:29:59,612::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00588386 s, 696 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:29:59,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00588408 s, 696 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:30:09,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6491755-c1ba-4746-be15-0f63f571cc79`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:30:09,264::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:30:09,264::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00588386', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00588408', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:30:09,264::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6491755-c1ba-4746-be15-0f63f571cc79`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00588386', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00588408', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:30:09,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6491755-c1ba-4746-be15-0f63f571cc79`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:30:09,264::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:30:09,265::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:30:09,265::task::993::Storage.TaskManager.Task::(_decref) Task=`a6491755-c1ba-4746-be15-0f63f571cc79`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:30:09,613::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:30:09,622::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:30:09,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00421922 s, 971 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:30:09,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00419215 s, 977 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:30:19,632::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:30:19,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:30:19,647::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00375955 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:30:19,650::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.003728 s, 1.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:30:24,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2d7ffbf-fd5c-47a8-9c2b-42ab52c43e26`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:30:24,426::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:30:24,426::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00375955', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.003728', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:30:24,426::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2d7ffbf-fd5c-47a8-9c2b-42ab52c43e26`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00375955', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.003728', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:30:24,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2d7ffbf-fd5c-47a8-9c2b-42ab52c43e26`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:30:24,427::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:30:24,427::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:30:24,427::task::993::Storage.TaskManager.Task::(_decref) Task=`d2d7ffbf-fd5c-47a8-9c2b-42ab52c43e26`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:30:29,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:30:29,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:30:29,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00903502 s, 453 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:30:29,669::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00506016 s, 809 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:30:39,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`a471d7d5-ab29-457c-892d-aeb85454db4d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:30:39,578::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:30:39,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00903502', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00506016', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:30:39,579::task::1191::Storage.TaskManager.Task::(prepare) Task=`a471d7d5-ab29-457c-892d-aeb85454db4d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00903502', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00506016', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:30:39,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`a471d7d5-ab29-457c-892d-aeb85454db4d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:30:39,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:30:39,580::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:30:39,581::task::993::Storage.TaskManager.Task::(_decref) Task=`a471d7d5-ab29-457c-892d-aeb85454db4d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:30:39,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:30:39,674::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:30:39,682::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00497274 s, 824 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:30:39,687::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00494425 s, 828 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:30:49,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:30:49,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:30:49,701::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00538062 s, 761 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:30:49,706::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00527628 s, 776 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:30:54,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`99849c49-940e-4eb2-a87c-54f7cfe0d484`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:30:54,779::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:30:54,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00538062', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00527628', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:30:54,780::task::1191::Storage.TaskManager.Task::(prepare) Task=`99849c49-940e-4eb2-a87c-54f7cfe0d484`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00538062', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00527628', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:30:54,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`99849c49-940e-4eb2-a87c-54f7cfe0d484`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:30:54,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:30:54,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:30:54,780::task::993::Storage.TaskManager.Task::(_decref) Task=`99849c49-940e-4eb2-a87c-54f7cfe0d484`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:30:59,705::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:30:59,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:30:59,727::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00430637 s, 951 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:30:59,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00447846 s, 915 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:31:09,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:31:09,744::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0042988 s, 953 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:31:09,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:31:09,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00418325 s, 979 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:31:09,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`04309fb1-7282-44c3-8270-25f23ef0b40d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:31:09,935::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:31:09,935::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0042988', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00418325', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:31:09,935::task::1191::Storage.TaskManager.Task::(prepare) Task=`04309fb1-7282-44c3-8270-25f23ef0b40d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0042988', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00418325', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:31:09,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`04309fb1-7282-44c3-8270-25f23ef0b40d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:31:09,935::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:31:09,936::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:31:09,936::task::993::Storage.TaskManager.Task::(_decref) Task=`04309fb1-7282-44c3-8270-25f23ef0b40d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:31:19,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:31:19,753::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734789 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:31:19,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:31:19,767::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595471 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:31:25,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`78adbfac-c5b1-40e0-9875-35a632820004`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:31:25,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:31:25,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734789', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595471', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:31:25,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`78adbfac-c5b1-40e0-9875-35a632820004`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734789', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595471', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:31:25,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`78adbfac-c5b1-40e0-9875-35a632820004`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:31:25,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:31:25,075::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:31:25,075::task::993::Storage.TaskManager.Task::(_decref) Task=`78adbfac-c5b1-40e0-9875-35a632820004`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:31:29,755::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:31:29,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722984 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:31:29,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:31:29,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662015 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:31:39,766::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:31:39,775::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602178 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:31:39,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:31:39,788::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581638 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:31:40,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`61e498b2-78d7-4975-aca9-237883770f94`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:31:40,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:31:40,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602178', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581638', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:31:40,185::task::1191::Storage.TaskManager.Task::(prepare) Task=`61e498b2-78d7-4975-aca9-237883770f94`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602178', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581638', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:31:40,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`61e498b2-78d7-4975-aca9-237883770f94`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:31:40,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:31:40,185::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:31:40,185::task::993::Storage.TaskManager.Task::(_decref) Task=`61e498b2-78d7-4975-aca9-237883770f94`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:31:49,776::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:31:49,785::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580378 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:31:49,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:31:49,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000549532 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:31:55,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fdc7b50-9203-49e8-b7c1-448932a17303`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:31:55,288::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:31:55,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580378', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549532', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:31:55,288::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fdc7b50-9203-49e8-b7c1-448932a17303`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580378', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549532', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:31:55,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fdc7b50-9203-49e8-b7c1-448932a17303`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:31:55,289::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:31:55,289::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:31:55,289::task::993::Storage.TaskManager.Task::(_decref) Task=`5fdc7b50-9203-49e8-b7c1-448932a17303`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:31:59,786::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:31:59,794::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579334 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:31:59,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:31:59,812::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608796 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:32:09,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:32:09,804::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644073 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:32:09,828::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:32:09,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613623 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:32:10,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4cb7c81-aecf-4180-9733-456657d7e995`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:32:10,407::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:32:10,407::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644073', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613623', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:32:10,407::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4cb7c81-aecf-4180-9733-456657d7e995`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644073', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613623', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:32:10,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4cb7c81-aecf-4180-9733-456657d7e995`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:32:10,408::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:32:10,408::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:32:10,408::task::993::Storage.TaskManager.Task::(_decref) Task=`e4cb7c81-aecf-4180-9733-456657d7e995`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:32:19,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:32:19,815::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615022 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:32:19,839::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:32:19,848::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065101 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:32:25,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`54e2a674-e924-4ed1-a3a4-76eb576057a9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:32:25,676::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:32:25,677::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615022', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065101', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:32:25,677::task::1191::Storage.TaskManager.Task::(prepare) Task=`54e2a674-e924-4ed1-a3a4-76eb576057a9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615022', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065101', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:32:25,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`54e2a674-e924-4ed1-a3a4-76eb576057a9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:32:25,677::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:32:25,677::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:32:25,677::task::993::Storage.TaskManager.Task::(_decref) Task=`54e2a674-e924-4ed1-a3a4-76eb576057a9`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:32:29,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:32:29,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000538437 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:32:29,851::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:32:29,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592701 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:32:39,827::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:32:39,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000743685 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:32:39,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:32:39,870::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641633 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:32:40,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`e081495f-9367-4a00-a6b8-9ecd50b24eed`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:32:40,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:32:40,787::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743685', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641633', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:32:40,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`e081495f-9367-4a00-a6b8-9ecd50b24eed`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743685', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641633', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:32:40,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`e081495f-9367-4a00-a6b8-9ecd50b24eed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:32:40,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:32:40,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:32:40,788::task::993::Storage.TaskManager.Task::(_decref) Task=`e081495f-9367-4a00-a6b8-9ecd50b24eed`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:32:49,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:32:49,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058003 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:32:49,874::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:32:49,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666943 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:32:55,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e1dda00-a4f2-44d6-8958-177db79860f2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:32:55,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:32:55,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058003', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666943', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:32:55,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e1dda00-a4f2-44d6-8958-177db79860f2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058003', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666943', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:32:55,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e1dda00-a4f2-44d6-8958-177db79860f2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:32:55,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:32:55,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:32:55,907::task::993::Storage.TaskManager.Task::(_decref) Task=`1e1dda00-a4f2-44d6-8958-177db79860f2`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:32:59,848::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:32:59,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633559 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:32:59,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:32:59,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726772 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:33:09,857::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:33:09,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000556206 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:33:09,896::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:09,904::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612266 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:33:11,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`4480b73b-dc0e-4971-bc81-bd987cb97f35`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:33:11,110::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:33:11,110::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556206', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612266', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:33:11,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`4480b73b-dc0e-4971-bc81-bd987cb97f35`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556206', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612266', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:33:11,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`4480b73b-dc0e-4971-bc81-bd987cb97f35`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:33:11,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:33:11,111::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:33:11,111::task::993::Storage.TaskManager.Task::(_decref) Task=`4480b73b-dc0e-4971-bc81-bd987cb97f35`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:33:19,868::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:33:19,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731054 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:33:19,908::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:19,915::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599289 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:33:26,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`47710060-65f9-4978-8614-4356080647e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:33:26,219::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:33:26,219::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731054', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599289', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:33:26,219::task::1191::Storage.TaskManager.Task::(prepare) Task=`47710060-65f9-4978-8614-4356080647e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731054', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599289', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:33:26,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`47710060-65f9-4978-8614-4356080647e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:33:26,220::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:33:26,220::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:33:26,220::task::993::Storage.TaskManager.Task::(_decref) Task=`47710060-65f9-4978-8614-4356080647e5`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:33:29,878::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:33:29,886::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661942 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:33:29,918::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:29,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742307 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:33:39,887::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:33:39,888::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:33:39,896::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:33:39,905::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000675299 s, 3.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:33:39,905::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000675299 s, 3.0 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:33:39,905::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:33:39,905::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:33:39,906::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:33:39,906::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:33:39,906::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:33:39,906::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:33:39,907::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:33:39,907::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:33:39,907::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:39,929::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:33:39,930::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:33:39,930::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:39,938::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00058289 s, 3.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:33:39,939::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00058289 s, 3.5 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:33:39,939::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:33:39,939::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:33:39,939::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:33:39,940::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 16:33:40,153::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:33:40,154::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:33:40,154::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 16:33:40,155::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:33:40,158::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 16:33:40,159::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:33:40,160::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-17::DEBUG::2014-08-12 16:33:40,160::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::INFO::2014-08-12 16:33:40,161::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:33:40,163::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:33:40,163::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:40,172::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:33:40,173::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:33:40,333::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:33:40,334::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:33:40,342::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000465714 s, 8.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:33:40,350::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:33:40,350::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:33:40,351::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:33:40,352::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:33:40,352::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:33:40,352::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:33:40,352::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:40,526::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:33:40,527::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:40,535::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056247 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:33:41,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`84b32e43-98c9-42d2-b645-bcfa936a727a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:33:41,341::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:33:41,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465714', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056247', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:33:41,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`84b32e43-98c9-42d2-b645-bcfa936a727a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465714', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056247', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:33:41,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`84b32e43-98c9-42d2-b645-bcfa936a727a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:33:41,342::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:33:41,342::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:33:41,342::task::993::Storage.TaskManager.Task::(_decref) Task=`84b32e43-98c9-42d2-b645-bcfa936a727a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:33:50,344::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:33:50,353::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644072 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:33:50,537::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:33:50,546::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587643 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:33:56,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fb45a8f-5c7d-4edb-a4e1-1efae3b20f90`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:33:56,479::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:33:56,479::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644072', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587643', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:33:56,480::task::1191::Storage.TaskManager.Task::(prepare) Task=`3fb45a8f-5c7d-4edb-a4e1-1efae3b20f90`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644072', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587643', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:33:56,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fb45a8f-5c7d-4edb-a4e1-1efae3b20f90`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:33:56,480::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:33:56,480::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:33:56,480::task::993::Storage.TaskManager.Task::(_decref) Task=`3fb45a8f-5c7d-4edb-a4e1-1efae3b20f90`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:34:00,356::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:34:00,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000549769 s, 7.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:34:00,549::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:34:00,557::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647026 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:34:10,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:34:10,374::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706557 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:34:10,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:34:10,568::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630493 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:34:11,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`afe127fa-0bc1-428e-be37-f78aafffd099`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:34:11,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:34:11,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706557', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630493', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:34:11,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`afe127fa-0bc1-428e-be37-f78aafffd099`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706557', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630493', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:34:11,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`afe127fa-0bc1-428e-be37-f78aafffd099`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:34:11,585::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:34:11,585::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:34:11,585::task::993::Storage.TaskManager.Task::(_decref) Task=`afe127fa-0bc1-428e-be37-f78aafffd099`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:34:20,376::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:34:20,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654785 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:34:20,572::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:34:20,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558235 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:34:26,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`f960cf6f-74b2-4e81-97ec-a02222cd0f09`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:34:26,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:34:26,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654785', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558235', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:34:26,691::task::1191::Storage.TaskManager.Task::(prepare) Task=`f960cf6f-74b2-4e81-97ec-a02222cd0f09`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654785', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558235', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:34:26,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`f960cf6f-74b2-4e81-97ec-a02222cd0f09`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:34:26,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:34:26,692::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:34:26,692::task::993::Storage.TaskManager.Task::(_decref) Task=`f960cf6f-74b2-4e81-97ec-a02222cd0f09`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:34:30,386::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:34:30,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000541262 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:34:30,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:34:30,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754795 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:34:40,396::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:34:40,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752393 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:34:40,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:34:40,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596052 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:34:41,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8dae76b-4d76-4337-8fa5-b0d236917ad8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:34:41,805::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:34:41,816::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752393', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596052', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:34:41,816::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8dae76b-4d76-4337-8fa5-b0d236917ad8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752393', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596052', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:34:41,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8dae76b-4d76-4337-8fa5-b0d236917ad8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:34:41,816::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:34:41,817::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:34:41,817::task::993::Storage.TaskManager.Task::(_decref) Task=`b8dae76b-4d76-4337-8fa5-b0d236917ad8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:34:50,406::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:34:50,415::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628963 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:34:50,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:34:50,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601472 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:35:00,417::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:35:00,425::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066388 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:35:00,629::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:35:00,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697021 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:35:10,427::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:35:10,435::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604011 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:35:10,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:35:10,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548113 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:35:12,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`69cd3253-1d83-46c1-a771-fa51ee7001e2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:35:12,657::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:35:12,658::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604011', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548113', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:35:12,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`69cd3253-1d83-46c1-a771-fa51ee7001e2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604011', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548113', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:35:12,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`69cd3253-1d83-46c1-a771-fa51ee7001e2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:35:12,658::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:35:12,658::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:35:12,659::task::993::Storage.TaskManager.Task::(_decref) Task=`69cd3253-1d83-46c1-a771-fa51ee7001e2`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:35:20,437::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:35:20,446::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670079 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:35:20,651::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:35:20,660::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000573445 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:35:27,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcfd0766-9053-4f5e-8062-eeb1852de7e6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:35:27,863::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:35:27,864::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670079', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573445', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:35:27,864::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcfd0766-9053-4f5e-8062-eeb1852de7e6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670079', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573445', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:35:27,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcfd0766-9053-4f5e-8062-eeb1852de7e6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:35:27,864::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:35:27,864::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:35:27,864::task::993::Storage.TaskManager.Task::(_decref) Task=`bcfd0766-9053-4f5e-8062-eeb1852de7e6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:35:30,447::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:35:30,455::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592335 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:35:30,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:35:30,671::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705423 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:35:40,457::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:35:40,465::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756149 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:35:40,674::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:35:40,682::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000769318 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:35:43,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf79cda9-8489-43b7-a6f0-da204ade88e6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:35:43,027::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:35:43,028::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756149', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769318', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:35:43,028::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf79cda9-8489-43b7-a6f0-da204ade88e6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756149', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769318', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:35:43,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf79cda9-8489-43b7-a6f0-da204ade88e6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:35:43,028::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:35:43,028::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:35:43,028::task::993::Storage.TaskManager.Task::(_decref) Task=`bf79cda9-8489-43b7-a6f0-da204ade88e6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:35:50,467::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:35:50,475::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581942 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:35:50,685::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:35:50,692::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574414 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:35:58,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0ef09e7-f82b-40b5-ab12-1f2e23fa9dec`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:35:58,142::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:35:58,142::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581942', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574414', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:35:58,142::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0ef09e7-f82b-40b5-ab12-1f2e23fa9dec`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581942', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574414', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:35:58,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0ef09e7-f82b-40b5-ab12-1f2e23fa9dec`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:35:58,142::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:35:58,143::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:35:58,143::task::993::Storage.TaskManager.Task::(_decref) Task=`c0ef09e7-f82b-40b5-ab12-1f2e23fa9dec`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:36:00,477::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:36:00,485::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619483 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:36:00,695::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:36:00,704::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645091 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:36:10,486::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:36:10,495::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558531 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:36:10,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:36:10,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562755 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:36:13,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`e237476c-0717-407f-8a67-babb2e416d77`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:36:13,289::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:36:13,289::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558531', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562755', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:36:13,290::task::1191::Storage.TaskManager.Task::(prepare) Task=`e237476c-0717-407f-8a67-babb2e416d77`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558531', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562755', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:36:13,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`e237476c-0717-407f-8a67-babb2e416d77`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:36:13,290::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:36:13,290::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:36:13,290::task::993::Storage.TaskManager.Task::(_decref) Task=`e237476c-0717-407f-8a67-babb2e416d77`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:36:20,496::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:36:20,505::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642136 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:36:20,719::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:36:20,727::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644136 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:36:28,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c79569f-00a8-40cb-be10-a450ce5a5021`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:36:28,475::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:36:28,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642136', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644136', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:36:28,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c79569f-00a8-40cb-be10-a450ce5a5021`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642136', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644136', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:36:28,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c79569f-00a8-40cb-be10-a450ce5a5021`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:36:28,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:36:28,476::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:36:28,476::task::993::Storage.TaskManager.Task::(_decref) Task=`3c79569f-00a8-40cb-be10-a450ce5a5021`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:36:30,507::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:36:30,515::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000527672 s, 7.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:36:30,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:36:30,738::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664286 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:36:40,517::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:36:40,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061217 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:36:40,742::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:36:40,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601768 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:36:43,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`340bf56d-2a74-4d23-bfb5-b2d628623e3f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:36:43,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:36:43,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061217', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601768', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:36:43,719::task::1191::Storage.TaskManager.Task::(prepare) Task=`340bf56d-2a74-4d23-bfb5-b2d628623e3f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061217', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601768', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:36:43,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`340bf56d-2a74-4d23-bfb5-b2d628623e3f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:36:43,719::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:36:43,719::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:36:43,719::task::993::Storage.TaskManager.Task::(_decref) Task=`340bf56d-2a74-4d23-bfb5-b2d628623e3f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:36:50,527::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:36:50,536::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000525577 s, 7.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:36:50,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:36:50,761::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000425776 s, 9.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:36:58,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`de0a414b-88e6-4684-b83e-caa3a0caa582`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:36:58,934::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:36:58,934::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525577', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425776', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:36:58,934::task::1191::Storage.TaskManager.Task::(prepare) Task=`de0a414b-88e6-4684-b83e-caa3a0caa582`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525577', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425776', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:36:58,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`de0a414b-88e6-4684-b83e-caa3a0caa582`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:36:58,934::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:36:58,935::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:36:58,935::task::993::Storage.TaskManager.Task::(_decref) Task=`de0a414b-88e6-4684-b83e-caa3a0caa582`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:37:00,538::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:37:00,546::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608541 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:37:00,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:37:00,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633405 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:37:10,552::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:37:10,561::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634594 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:37:10,775::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:37:10,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674865 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:37:14,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`e57d0975-af95-4bdb-9345-c3c36dacc24f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:37:14,082::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:37:14,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634594', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674865', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:37:14,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`e57d0975-af95-4bdb-9345-c3c36dacc24f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634594', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674865', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:37:14,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`e57d0975-af95-4bdb-9345-c3c36dacc24f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:37:14,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:37:14,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:37:14,083::task::993::Storage.TaskManager.Task::(_decref) Task=`e57d0975-af95-4bdb-9345-c3c36dacc24f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:37:20,562::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:37:20,570::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664938 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:37:20,786::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:37:20,793::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686964 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:37:29,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0422b0b-f2ab-4cf7-a177-6bf1ced48dd8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:37:29,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:37:29,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664938', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686964', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:37:29,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0422b0b-f2ab-4cf7-a177-6bf1ced48dd8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664938', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686964', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:37:29,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0422b0b-f2ab-4cf7-a177-6bf1ced48dd8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:37:29,208::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:37:29,209::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:37:29,209::task::993::Storage.TaskManager.Task::(_decref) Task=`a0422b0b-f2ab-4cf7-a177-6bf1ced48dd8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:37:30,572::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:37:30,580::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057588 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:37:30,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:37:30,804::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711916 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:37:38,192::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4b058020] >Thread-15::DEBUG::2014-08-12 16:37:38,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`aea887f3-0903-44f4-b472-01e4fc7f2158`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:37:38,193::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:37:38,195::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 16:37:38,196::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=6,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Detector thread::DEBUG::2014-08-12 16:37:38,372::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.161.45:51471 >Detector thread::DEBUG::2014-08-12 16:37:38,372::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.161.45:51471 >Detector thread::DEBUG::2014-08-12 16:37:38,373::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.161.45:51471 >Detector thread::DEBUG::2014-08-12 16:37:38,373::BindingXMLRPC::1167::XmlDetector::(handleSocket) xml over http detected from ('10.35.161.45', 51471) >Thread-16::DEBUG::2014-08-12 16:37:40,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:37:40,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644705 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:37:40,808::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:37:40,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066593 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:37:43,453::__init__::157::IOProcessClient::(_run) Starting IOProcess... >Thread-29::INFO::2014-08-12 16:37:43,467::__init__::227::IOProcess::(_processLogs) Starting ioprocess >Thread-29::DEBUG::2014-08-12 16:37:43,468::__init__::225::IOProcess::(_processLogs) Closing unrelated FDs... >Thread-29::DEBUG::2014-08-12 16:37:43,468::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 0 (pipe:[34980293]) >Thread-29::DEBUG::2014-08-12 16:37:43,468::__init__::225::IOProcess::(_processLogs) Not closing FD 1 because it's in whitelist >Thread-29::DEBUG::2014-08-12 16:37:43,468::__init__::225::IOProcess::(_processLogs) Not closing FD 2 because it's in whitelist >Thread-29::DEBUG::2014-08-12 16:37:43,468::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 3 (socket:[34879981]) >Thread-29::DEBUG::2014-08-12 16:37:43,468::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 4 (/var/log/vdsm/vdsm.log) >Thread-29::DEBUG::2014-08-12 16:37:43,469::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 5 (/var/log/vdsm/connectivity.log) >Thread-29::DEBUG::2014-08-12 16:37:43,469::__init__::225::IOProcess::(_processLogs) Not closing FD 6 because it's the directory fd >Thread-29::DEBUG::2014-08-12 16:37:43,469::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 10 ([eventpoll]sm/connectivity.log) >Thread-29::DEBUG::2014-08-12 16:37:43,469::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 11 (socket:[34879998]nectivity.log) >Thread-29::DEBUG::2014-08-12 16:37:43,469::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 12 (/var/log/vdsm/mom.logivity.log) >Thread-29::DEBUG::2014-08-12 16:37:43,469::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 13 (/sys/kernel/mm/ksm/sleep_millisecs) >Thread-29::DEBUG::2014-08-12 16:37:43,469::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 14 (/sys/kernel/mm/ksm/pages_to_scancs) >Thread-29::DEBUG::2014-08-12 16:37:43,470::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 15 (/proc/cpuinfom/ksm/pages_to_scancs) >Thread-29::DEBUG::2014-08-12 16:37:43,470::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 16 (socket:[34880054]m/pages_to_scancs) >Thread-29::DEBUG::2014-08-12 16:37:43,470::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 17 (/proc/meminfo054]m/pages_to_scancs) >Thread-29::DEBUG::2014-08-12 16:37:43,470::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 19 (/sys/kernel/mm/ksm/pages_volatiles) >Thread-29::DEBUG::2014-08-12 16:37:43,470::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 20 (/proc/vmstatmm/ksm/pages_volatiles) >Thread-29::DEBUG::2014-08-12 16:37:43,471::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 21 (/sys/kernel/mm/ksm/full_scanstiles) >Thread-29::DEBUG::2014-08-12 16:37:43,471::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 22 (/sys/kernel/mm/ksm/pages_sharinges) >Thread-29::DEBUG::2014-08-12 16:37:43,471::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 23 (/sys/kernel/mm/ksm/pages_unshareds) >Thread-29::DEBUG::2014-08-12 16:37:43,471::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 24 (/sys/kernel/mm/ksm/runes_unshareds) >Thread-29::DEBUG::2014-08-12 16:37:43,472::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 25 (/sys/kernel/mm/ksm/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,472::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 30 (socket:[34881015]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,472::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 32 (socket:[34880111]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,472::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 34 (pipe:[34880203]1]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,472::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 36 (socket:[34881032]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,472::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 37 (pipe:[34880203]2]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,472::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 38 (pipe:[34980290]2]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,473::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 39 (socket:[34881977]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,473::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 42 (socket:[34883658]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,473::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[34980290]8]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,473::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 44 (pipe:[34980291]8]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,473::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 45 (socket:[34980007]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,473::__init__::225::IOProcess::(_processLogs) Not closing FD 46 because it's in whitelist >Thread-29::DEBUG::2014-08-12 16:37:43,474::__init__::225::IOProcess::(_processLogs) Not closing FD 47 because it's in whitelist >Thread-29::DEBUG::2014-08-12 16:37:43,474::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 48 (pipe:[34980292]7]m/pages_sharededs) >Thread-29::DEBUG::2014-08-12 16:37:43,474::__init__::225::IOProcess::(_processLogs) Opening communication channels... >Thread-29::DEBUG::2014-08-12 16:37:43,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,474::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-29::DEBUG::2014-08-12 16:37:43,474::__init__::225::IOProcess::(_processLogs) Message size is 140 >Thread-29::DEBUG::2014-08-12 16:37:43,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:37:43,475::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:37:43,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,475::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:37:43,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:37:43,475::__init__::225::IOProcess::(_processLogs) (1) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:37:43,475::__init__::225::IOProcess::(_processLogs) (1) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:37:43,476::__init__::225::IOProcess::(_processLogs) (1) Building response >Thread-29::DEBUG::2014-08-12 16:37:43,476::__init__::225::IOProcess::(_processLogs) (1) Queuing response >Thread-29::DEBUG::2014-08-12 16:37:43,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:37:43,476::__init__::225::IOProcess::(_processLogs) Sending response sized 71 >Thread-15::DEBUG::2014-08-12 16:37:43,497::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:37:43,498::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:37:43,498::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-29::DEBUG::2014-08-12 16:37:43,498::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:37:43,498::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:37:43,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:37:43,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:37:43,499::__init__::225::IOProcess::(_processLogs) (2) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:37:43,499::__init__::225::IOProcess::(_processLogs) (2) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:37:43,500::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|(2) Building response >Thread-15::DEBUG::2014-08-12 16:37:43,500::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-29::DEBUG::2014-08-12 16:37:43,500::__init__::225::IOProcess::(_processLogs) (2) Queuing response >Thread-29::DEBUG::2014-08-12 16:37:43,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 16:37:43,501::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 16:37:43,502::__init__::225::IOProcess::(_processLogs) Sending response sized 190 >Thread-15::INFO::2014-08-12 16:37:43,503::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:37:43,503::task::1191::Storage.TaskManager.Task::(prepare) Task=`aea887f3-0903-44f4-b472-01e4fc7f2158`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:37:43,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`aea887f3-0903-44f4-b472-01e4fc7f2158`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:37:43,503::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:37:43,504::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:37:43,504::task::993::Storage.TaskManager.Task::(_decref) Task=`aea887f3-0903-44f4-b472-01e4fc7f2158`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:37:43,512::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [286620c3] >Thread-15::DEBUG::2014-08-12 16:37:43,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`245a8240-9232-4b6e-96a1-e6e69fcd92af`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:37:43,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='0adb6530-ef5f-41f0-8655-a7ca83123c87', options=None) >Thread-15::DEBUG::2014-08-12 16:37:43,513::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:37:43,513::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:37:43,513::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:37:43,514::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:37:43,514::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:37:43,514::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:37:43,540::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:37:43,541::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:37:43,653::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:37:43,654::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:37:43,654::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:37:43,654::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:37:43,654::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:37:43,654::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:37:43,655::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:37:43,655::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-29::DEBUG::2014-08-12 16:37:43,657::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:37:43,657::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-29::DEBUG::2014-08-12 16:37:43,657::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:37:43,657::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:37:43,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,657::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:37:43,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:37:43,658::__init__::225::IOProcess::(_processLogs) (3) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:37:43,658::__init__::225::IOProcess::(_processLogs) (3) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:37:43,658::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|(3) Building response >Thread-29::DEBUG::2014-08-12 16:37:43,660::__init__::225::IOProcess::(_processLogs) (3) Queuing response >Thread-29::DEBUG::2014-08-12 16:37:43,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:37:43,662::__init__::225::IOProcess::(_processLogs) Sending response sized 197 >Thread-15::DEBUG::2014-08-12 16:37:43,664::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:37:43,665::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:37:43,665::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 16:37:43,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:37:43,665::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:37:43,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:37:43,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:37:43,666::__init__::225::IOProcess::(_processLogs) (4) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:37:43,666::__init__::225::IOProcess::(_processLogs) (4) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 16:37:43,667::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|(4) Building response >Thread-29::DEBUG::2014-08-12 16:37:43,667::__init__::225::IOProcess::(_processLogs) (4) Queuing response >Thread-29::DEBUG::2014-08-12 16:37:43,667::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:37:43,668::__init__::225::IOProcess::(_processLogs) Sending response sized 71 >Thread-15::DEBUG::2014-08-12 16:37:43,668::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:37:43,669::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:37:43,669::__init__::225::IOProcess::(_processLogs) Message size is 200 >Thread-29::DEBUG::2014-08-12 16:37:43,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:37:43,670::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:37:43,670::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:37:43,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:37:43,670::__init__::225::IOProcess::(_processLogs) (5) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:37:43,670::__init__::225::IOProcess::(_processLogs) (5) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:37:43,671::__init__::225::IOProcess::(_processLogs) Closing unrelated fd no: 43 (pipe:[3498029DEBUG|(5) Building response >Thread-29::DEBUG::2014-08-12 16:37:43,672::__init__::225::IOProcess::(_processLogs) (5) Queuing response >Thread-29::DEBUG::2014-08-12 16:37:43,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 16:37:43,672::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=674aee93c8b731bf0e42767249a6c48454b08d0e'] >Thread-29::DEBUG::2014-08-12 16:37:43,673::__init__::225::IOProcess::(_processLogs) Sending response sized 493 >Thread-29::DEBUG::2014-08-12 16:37:43,675::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-29::DEBUG::2014-08-12 16:37:43,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:37:43,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:37:43,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:37:43,676::__init__::225::IOProcess::(_processLogs) (6) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:37:43,676::__init__::225::IOProcess::(_processLogs) (6) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:37:43,677::__init__::225::IOProcess::(_processLogs) (6) Building response >Thread-29::DEBUG::2014-08-12 16:37:43,677::__init__::225::IOProcess::(_processLogs) (6) Queuing response >Thread-29::DEBUG::2014-08-12 16:37:43,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:37:43,677::__init__::225::IOProcess::(_processLogs) Sending response sized 71 >Thread-29::DEBUG::2014-08-12 16:37:43,677::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 16:37:43,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:37:43,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:37:43,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:37:43,678::__init__::225::IOProcess::(_processLogs) (7) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:37:43,678::__init__::225::IOProcess::(_processLogs) (7) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:37:43,679::__init__::225::IOProcess::(_processLogs) (7) Queuing response >Thread-15::DEBUG::2014-08-12 16:37:43,679::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 16:37:43,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:37:43,681::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 16:37:43,681::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS' >Thread-15::DEBUG::2014-08-12 16:37:43,682::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS' >Thread-15::INFO::2014-08-12 16:37:43,682::fileSD::339::Storage.StorageDomain::(validate) sdUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:37:43,682::__init__::225::IOProcess::(_processLogs) Message size is 200 >Thread-29::DEBUG::2014-08-12 16:37:43,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:37:43,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:37:43,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:37:43,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:37:43,683::__init__::225::IOProcess::(_processLogs) (8) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:37:43,683::__init__::225::IOProcess::(_processLogs) (8) Got request for method 'readfile' >Thread-15::DEBUG::2014-08-12 16:37:43,684::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=674aee93c8b731bf0e42767249a6c48454b08d0e'] >Thread-29::DEBUG::2014-08-12 16:37:43,684::__init__::225::IOProcess::(_processLogs) Sending response sized 493 >Thread-15::DEBUG::2014-08-12 16:37:43,686::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87`ReqID=`f9b154bc-abb2-4ccf-89f6-fb872dcb6914`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2806' at 'getStorageDomainInfo' >Thread-15::DEBUG::2014-08-12 16:37:43,686::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:37:43,686::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:37:43,687::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87`ReqID=`f9b154bc-abb2-4ccf-89f6-fb872dcb6914`::Granted request >Thread-15::DEBUG::2014-08-12 16:37:43,688::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`245a8240-9232-4b6e-96a1-e6e69fcd92af`::_resourcesAcquired: Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87 (shared) >Thread-15::DEBUG::2014-08-12 16:37:43,688::task::993::Storage.TaskManager.Task::(_decref) Task=`245a8240-9232-4b6e-96a1-e6e69fcd92af`::ref 1 aborting False >Thread-15::INFO::2014-08-12 16:37:43,690::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'0adb6530-ef5f-41f0-8655-a7ca83123c87', 'version': '3', 'role': 'Regular', 'remotePath': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'pNFS'}} >Thread-15::DEBUG::2014-08-12 16:37:43,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`245a8240-9232-4b6e-96a1-e6e69fcd92af`::finished: {'info': {'uuid': u'0adb6530-ef5f-41f0-8655-a7ca83123c87', 'version': '3', 'role': 'Regular', 'remotePath': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'pNFS'}} >Thread-15::DEBUG::2014-08-12 16:37:43,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`245a8240-9232-4b6e-96a1-e6e69fcd92af`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:37:43,691::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87': < ResourceRef 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 16:37:43,691::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:37:43,691::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' >Thread-15::DEBUG::2014-08-12 16:37:43,691::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' (0 active users) >Thread-15::DEBUG::2014-08-12 16:37:43,691::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:37:43,692::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87', Clearing records. >Thread-15::DEBUG::2014-08-12 16:37:43,692::task::993::Storage.TaskManager.Task::(_decref) Task=`245a8240-9232-4b6e-96a1-e6e69fcd92af`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:37:44,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`7394ef3c-8795-4d60-9900-e2320aa3cd59`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:37:44,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:37:44,455::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644705', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066593', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:37:44,456::task::1191::Storage.TaskManager.Task::(prepare) Task=`7394ef3c-8795-4d60-9900-e2320aa3cd59`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644705', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066593', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:37:44,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`7394ef3c-8795-4d60-9900-e2320aa3cd59`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:37:44,456::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:37:44,456::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:37:44,456::task::993::Storage.TaskManager.Task::(_decref) Task=`7394ef3c-8795-4d60-9900-e2320aa3cd59`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:37:50,596::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:37:50,599::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:37:50,819::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-17::DEBUG::2014-08-12 16:37:50,821::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:37:50,830::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:37:50,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:37:50,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626146 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:37:51,003::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:37:51,003::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:37:51,004::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:37:51,011::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598852 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:37:59,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fbf3693-836b-4ce8-8908-38eda49c9793`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:37:59,604::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:37:59,604::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626146', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598852', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:37:59,604::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fbf3693-836b-4ce8-8908-38eda49c9793`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626146', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598852', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:37:59,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fbf3693-836b-4ce8-8908-38eda49c9793`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:37:59,605::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:37:59,605::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:37:59,605::task::993::Storage.TaskManager.Task::(_decref) Task=`5fbf3693-836b-4ce8-8908-38eda49c9793`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:38:00,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:00,851::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579091 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:38:01,016::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:01,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000782186 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:38:09,059::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [436f8526] >Thread-15::DEBUG::2014-08-12 16:38:09,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`70008597-a15f-4dae-8e12-e91658b07470`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:38:09,060::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:38:09,062::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:38:09,062::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-29::DEBUG::2014-08-12 16:38:09,063::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:09,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:09,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:09,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:09,063::__init__::225::IOProcess::(_processLogs) (9) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:38:09,063::__init__::225::IOProcess::(_processLogs) (9) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:38:09,064::__init__::225::IOProcess::(_processLogs) (9) Queuing response >Thread-15::DEBUG::2014-08-12 16:38:09,064::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-29::DEBUG::2014-08-12 16:38:09,064::__init__::225::IOProcess::(_processLogs) Sending response sized 190 >Thread-15::DEBUG::2014-08-12 16:38:09,065::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 16:38:09,066::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:38:09,066::task::1191::Storage.TaskManager.Task::(prepare) Task=`70008597-a15f-4dae-8e12-e91658b07470`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:38:09,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`70008597-a15f-4dae-8e12-e91658b07470`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:38:09,066::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:38:09,066::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:38:09,066::task::993::Storage.TaskManager.Task::(_decref) Task=`70008597-a15f-4dae-8e12-e91658b07470`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:38:09,282::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:38:09,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`3587e4d2-a85f-473a-8e64-db9fcbee737c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:38:09,283::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 16:38:09,284::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`7a7852c7-66e9-4d59-9591-6fdbcad44876`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:38:09,284::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:38:09,284::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:38:09,284::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`7a7852c7-66e9-4d59-9591-6fdbcad44876`::Granted request >Thread-15::DEBUG::2014-08-12 16:38:09,285::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`480e2f19-2143-4568-bdb7-c456912d88c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:38:09,285::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:38:09,285::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:38:09,285::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`480e2f19-2143-4568-bdb7-c456912d88c8`::Granted request >Thread-15::DEBUG::2014-08-12 16:38:09,286::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'active'} >Thread-15::INFO::2014-08-12 16:38:09,286::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'Active'} >Thread-15::DEBUG::2014-08-12 16:38:09,286::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,286::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,287::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,287::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,287::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,287::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,287::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:38:09,288::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:38:09,288::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:38:09,288::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:38:09,288::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:38:09,288::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:38:09,350::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:38:09,358::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:38:09,441::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:38:09,441::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,442::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,442::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,442::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,442::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,442::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,443::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:38:09,443::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,445::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:38:09,682::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:38:09,683::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,683::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:38:09,684::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:38:09,692::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0005034 s, 4.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:38:09,692::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0005034 s, 4.1 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:38:09,692::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:38:09,692::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:38:09,693::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:38:09,693::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,693::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,693::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,694::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,694::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,694::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:38:09,875::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:38:09,876::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:09,876::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:38:09,877::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:38:09,877::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:38:09,877::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:38:09,878::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 16:38:09,878::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:38:09,878::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 16:38:09,878::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:38:09,879::sp::1410::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` started monitoring domain `0adb6530-ef5f-41f0-8655-a7ca83123c87` >Thread-15::DEBUG::2014-08-12 16:38:09,879::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-31::DEBUG::2014-08-12 16:38:09,879::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:38:09,880::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:38:09,882::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 16:38:09,885::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-29::DEBUG::2014-08-12 16:38:09,886::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-15::DEBUG::2014-08-12 16:38:09,886::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf 0adb6530-ef5f-41f0-8655-a7ca83123c87 (cwd None) >Thread-29::DEBUG::2014-08-12 16:38:09,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:09,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:09,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:09,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:09,896::__init__::225::IOProcess::(_processLogs) (10) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:38:09,896::__init__::225::IOProcess::(_processLogs) (10) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:38:09,896::__init__::225::IOProcess::(_processLogs) (10) Building response >Thread-29::DEBUG::2014-08-12 16:38:09,897::__init__::225::IOProcess::(_processLogs) (10) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:09,897::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:38:09,897::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-31::DEBUG::2014-08-12 16:38:09,903::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:38:09,904::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 16:38:09,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:09,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:09,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:09,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:09,904::__init__::225::IOProcess::(_processLogs) (11) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:38:09,905::__init__::225::IOProcess::(_processLogs) (11) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 16:38:09,905::__init__::225::IOProcess::(_processLogs) (11) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:09,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-31::DEBUG::2014-08-12 16:38:09,906::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:38:09,907::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:38:09,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:09,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:09,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:09,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:09,908::__init__::225::IOProcess::(_processLogs) (12) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:38:09,908::__init__::225::IOProcess::(_processLogs) (12) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:38:09,909::__init__::225::IOProcess::(_processLogs) (12) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:09,909::__init__::225::IOProcess::(_processLogs) Sending response sized 542 >Thread-31::DEBUG::2014-08-12 16:38:09,909::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=673835d8db3efe8685ee06bbf6bd04fd56d8e345'] >Thread-29::DEBUG::2014-08-12 16:38:09,911::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 16:38:09,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:09,911::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:09,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:09,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:09,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:09,912::__init__::225::IOProcess::(_processLogs) (13) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:38:09,912::__init__::225::IOProcess::(_processLogs) (13) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:38:09,912::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(13) Building response >Thread-29::DEBUG::2014-08-12 16:38:09,913::__init__::225::IOProcess::(_processLogs) (13) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:09,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:38:09,913::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:38:09,913::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:09,914::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-29::DEBUG::2014-08-12 16:38:09,914::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:09,914::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:09,914::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:09,914::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:09,914::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:09,914::__init__::225::IOProcess::(_processLogs) (14) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:38:09,915::__init__::225::IOProcess::(_processLogs) (14) Got request for method 'glob' >Thread-31::DEBUG::2014-08-12 16:38:09,915::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 16:38:09,915::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(14) Building response >Thread-31::INFO::2014-08-12 16:38:09,916::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-29::DEBUG::2014-08-12 16:38:09,916::__init__::225::IOProcess::(_processLogs) (14) Queuing response >Thread-31::INFO::2014-08-12 16:38:09,916::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-29::DEBUG::2014-08-12 16:38:09,917::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:38:09,918::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-29::DEBUG::2014-08-12 16:38:09,918::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:09,918::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:09,918::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:09,918::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:09,919::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:09,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:09,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:09,919::__init__::225::IOProcess::(_processLogs) (15) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:09,919::__init__::225::IOProcess::(_processLogs) (15) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:09,920::__init__::225::IOProcess::(_processLogs) (15) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:09,921::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:38:09,922::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-08-12 16:38:09,932::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00120444 s, 292 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:38:09,933::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:09,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:09,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:09,934::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:09,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:09,934::__init__::225::IOProcess::(_processLogs) (16) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:09,934::__init__::225::IOProcess::(_processLogs) (16) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:09,935::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:38:09,937::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 changed its status to Valid >Thread-31::INFO::2014-08-12 16:38:09,938::clusterlock::183::Storage.SANLock::(acquireHostId) Acquiring host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 (id: 1) >Thread-33::DEBUG::2014-08-12 16:38:09,938::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-33::DEBUG::2014-08-12 16:38:09,938::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-31::DEBUG::2014-08-12 16:38:09,938::clusterlock::201::Storage.SANLock::(acquireHostId) Host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 successfully acquired (id: 1) >Thread-33::DEBUG::2014-08-12 16:38:09,939::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-34::INFO::2014-08-12 16:38:09,940::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >Thread-15::DEBUG::2014-08-12 16:38:10,084::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "0adb6530-ef5f-41f0-8655-a7ca83123c87" not found\n Skipping volume group 0adb6530-ef5f-41f0-8655-a7ca83123c87\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 16:38:10,087::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [' DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc|180aea8f-26ba-4e87-8a94-37d5469519bf|wz--n-|42547019776|22011707392|134217728|317|164|MDT_LEASETIMESEC=60,MDT_VERSION=3,MDT_TYPE=ISCSI,MDT_SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf,MDT_PV0=pv:3600601601282300060dddcba33f2e311&44&uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP&44&pestart:0&44&pecount:317&44&mapoffset:0,MDT_LEASERETRIES=3,MDT_IOOPTIMEOUTSEC=10,MDT_LOCKRENEWALINTERVALSEC=5,MDT_LOCKPOLICY=,MDT_ROLE=Regular,MDT_PHYBLKSIZE=512,MDT_LOGBLKSIZE=512,MDT_VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc,MDT_CLASS=Data,MDT_DESCRIPTION=iscsi_1,RHAT_storage_domain,MDT_POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a,MDT__SHA_CKSUM=189d056969591a327adf4c729525fafb366effde|134217728|67100160|15|1|/dev/mapper/3600601601282300060dddcba33f2e311'] [' Volume group "0adb6530-ef5f-41f0-8655-a7ca83123c87" not found', ' Skipping volume group 0adb6530-ef5f-41f0-8655-a7ca83123c87'] >Thread-15::DEBUG::2014-08-12 16:38:10,087::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:38:10,087::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:38:10,087::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:38:10,088::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:38:10,088::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:38:10,089::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:38:10,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:10,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:10,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:10,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:10,090::__init__::225::IOProcess::(_processLogs) (17) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:38:10,090::__init__::225::IOProcess::(_processLogs) (17) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:38:10,090::__init__::225::IOProcess::(_processLogs) (17) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:10,091::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-15::INFO::2014-08-12 16:38:10,092::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 16:38:10,092::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::INFO::2014-08-12 16:38:10,093::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:38:10,093::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:38:10,093::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 16:38:10,093::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:38:10,093::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 16:38:10,094::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 16:38:10,094::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 16:38:10,094::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:38:10,094::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:38:10,095::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:38:10,095::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:38:10,095::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:38:10,095::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:38:10,095::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:38:10,096::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:38:10,096::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:38:10,096::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:38:10,096::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:38:10,096::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:38:10,097::task::1191::Storage.TaskManager.Task::(prepare) Task=`3587e4d2-a85f-473a-8e64-db9fcbee737c`::finished: True >Thread-15::DEBUG::2014-08-12 16:38:10,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`3587e4d2-a85f-473a-8e64-db9fcbee737c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:38:10,097::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:38:10,097::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:38:10,097::task::993::Storage.TaskManager.Task::(_decref) Task=`3587e4d2-a85f-473a-8e64-db9fcbee737c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:38:10,852::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:38:10,853::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:10,884::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000602851 s, 3.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:10,884::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000602851 s, 3.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:38:10,885::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:38:10,885::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:38:10,885::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:38:10,885::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:10,886::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:10,886::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:10,886::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:10,886::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:10,886::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:11,028::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:11,074::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:11,074::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:11,074::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:38:11,075::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:38:11,076::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:38:11,076::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:38:11,076::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:11,197::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:38:11,197::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:11,206::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000469855 s, 8.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:11,240::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:11,240::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:11,248::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000523465 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:38:14,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a7e0724-5506-418d-aa1a-819237e9c79d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:38:14,735::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:38:14,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523465', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469855', 'lastCheck': '3.5', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00120444', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:38:14,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a7e0724-5506-418d-aa1a-819237e9c79d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523465', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469855', 'lastCheck': '3.5', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00120444', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:38:14,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a7e0724-5506-418d-aa1a-819237e9c79d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:38:14,736::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:38:14,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:38:14,736::task::993::Storage.TaskManager.Task::(_decref) Task=`7a7e0724-5506-418d-aa1a-819237e9c79d`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:38:19,941::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:19,941::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:19,941::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:19,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:19,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:19,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:19,942::__init__::225::IOProcess::(_processLogs) (18) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:19,942::__init__::225::IOProcess::(_processLogs) (18) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:19,946::__init__::225::IOProcess::(_processLogs) DEBUG|(18) Building response >Thread-29::DEBUG::2014-08-12 16:38:19,946::__init__::225::IOProcess::(_processLogs) (18) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:19,947::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:38:19,949::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:38:19,949::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-08-12 16:38:19,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00134206 s, 262 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:38:19,964::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:19,964::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:19,965::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:19,965::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:19,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:19,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:19,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:19,965::__init__::225::IOProcess::(_processLogs) (19) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:19,966::__init__::225::IOProcess::(_processLogs) (19) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:19,967::__init__::225::IOProcess::(_processLogs) DEBUG|(19) Building response >Thread-29::DEBUG::2014-08-12 16:38:19,967::__init__::225::IOProcess::(_processLogs) (19) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:19,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:38:19,968::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:38:21,210::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:21,218::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000545136 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:21,250::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:21,259::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000529953 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:38:29,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef5ac873-948e-418e-ba40-9c1cf0b4e6cb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:38:29,864::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:38:29,864::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529953', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545136', 'lastCheck': '8.6', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00134206', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:38:29,864::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef5ac873-948e-418e-ba40-9c1cf0b4e6cb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529953', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545136', 'lastCheck': '8.6', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00134206', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:38:29,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef5ac873-948e-418e-ba40-9c1cf0b4e6cb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:38:29,865::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:38:29,865::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:38:29,865::task::993::Storage.TaskManager.Task::(_decref) Task=`ef5ac873-948e-418e-ba40-9c1cf0b4e6cb`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:38:29,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:29,969::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:29,969::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:29,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:29,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:29,969::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:29,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:29,970::__init__::225::IOProcess::(_processLogs) (20) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:29,970::__init__::225::IOProcess::(_processLogs) (20) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:29,971::__init__::225::IOProcess::(_processLogs) DEBUG|(20) Building response >Thread-31::DEBUG::2014-08-12 16:38:29,972::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:38:29,972::__init__::225::IOProcess::(_processLogs) (20) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:29,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-31::DEBUG::2014-08-12 16:38:29,981::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000325163 s, 1.1 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:38:29,982::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-29::DEBUG::2014-08-12 16:38:29,983::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:29,983::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:29,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:29,984::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:29,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:29,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:29,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:29,984::__init__::225::IOProcess::(_processLogs) (21) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:29,984::__init__::225::IOProcess::(_processLogs) (21) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:29,985::__init__::225::IOProcess::(_processLogs) (21) Building response >Thread-29::DEBUG::2014-08-12 16:38:29,985::__init__::225::IOProcess::(_processLogs) (21) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:29,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:38:29,986::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:38:31,222::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:31,230::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678651 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:31,260::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:31,268::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567849 s, 7.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:38:39,988::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:39,988::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:39,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:39,988::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:39,989::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:39,989::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:39,990::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-08-12 16:38:39,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:38:39,991::__init__::225::IOProcess::(_processLogs) (22) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:40,000::__init__::225::IOProcess::(_processLogs) (22) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:40,000::__init__::225::IOProcess::(_processLogs) (22) Building response >Thread-29::DEBUG::2014-08-12 16:38:40,000::__init__::225::IOProcess::(_processLogs) (22) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:40,000::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:38:40,000::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:38:40,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00130678 s, 269 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:38:40,004::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:40,004::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:40,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:40,005::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:40,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:40,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:40,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:40,005::__init__::225::IOProcess::(_processLogs) (23) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:40,005::__init__::225::IOProcess::(_processLogs) (23) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:40,006::__init__::225::IOProcess::(_processLogs) DEBUG|(23) Building response >Thread-29::DEBUG::2014-08-12 16:38:40,007::__init__::225::IOProcess::(_processLogs) (23) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:40,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:38:40,008::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:38:41,233::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:38:41,234::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:38:41,234::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:41,242::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000502087 s, 4.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:38:41,242::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000502087 s, 4.1 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:38:41,242::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:38:41,242::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:38:41,243::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:38:41,243::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:38:41,243::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:38:41,243::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:38:41,244::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:38:41,244::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:38:41,244::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:41,270::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:38:41,270::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:38:41,271::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:41,280::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000528008 s, 3.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:41,280::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000528008 s, 3.9 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:38:41,280::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:38:41,281::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:38:41,281::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:38:41,281::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 16:38:41,521::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:38:41,522::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:38:41,523::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 16:38:41,523::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:41,525::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 16:38:41,527::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::DEBUG::2014-08-12 16:38:41,528::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 16:38:41,528::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:38:41,529::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:38:41,530::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:38:41,531::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:41,532::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:41,540::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:41,700::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:38:41,701::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:41,709::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588616 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:41,728::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:41,728::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:38:41,728::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:38:41,729::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:38:41,729::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:38:41,730::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:38:41,730::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:41,900::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:41,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:41,909::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613076 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:38:44,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`43e0d7fc-4469-4a25-9272-115aab9d6c0f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:38:44,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:38:44,973::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613076', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588616', 'lastCheck': '3.3', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00130678', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:38:44,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`43e0d7fc-4469-4a25-9272-115aab9d6c0f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613076', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588616', 'lastCheck': '3.3', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00130678', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:38:44,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`43e0d7fc-4469-4a25-9272-115aab9d6c0f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:38:44,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:38:44,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:38:44,973::task::993::Storage.TaskManager.Task::(_decref) Task=`43e0d7fc-4469-4a25-9272-115aab9d6c0f`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:38:50,009::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:50,009::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:50,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:50,009::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:50,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:50,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:50,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:50,010::__init__::225::IOProcess::(_processLogs) (24) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:50,010::__init__::225::IOProcess::(_processLogs) (24) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:50,011::__init__::225::IOProcess::(_processLogs) DEBUG|(24) Building response >Thread-31::DEBUG::2014-08-12 16:38:50,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:38:50,012::__init__::225::IOProcess::(_processLogs) (24) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:50,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-31::DEBUG::2014-08-12 16:38:50,023::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000371045 s, 949 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:38:50,023::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-29::DEBUG::2014-08-12 16:38:50,025::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:38:50,025::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:38:50,025::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:38:50,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:38:50,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:38:50,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:38:50,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:38:50,026::__init__::225::IOProcess::(_processLogs) (25) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:38:50,026::__init__::225::IOProcess::(_processLogs) (25) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:38:50,027::__init__::225::IOProcess::(_processLogs) DEBUG|(25) Building response >Thread-29::DEBUG::2014-08-12 16:38:50,028::__init__::225::IOProcess::(_processLogs) (25) Queuing response >Thread-29::DEBUG::2014-08-12 16:38:50,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:38:50,029::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:38:51,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:38:51,725::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000475475 s, 8.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:38:51,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:38:51,919::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000434469 s, 9.4 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:00,030::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:00,030::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:00,030::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:00,030::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:00,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:00,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:00,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:00,031::__init__::225::IOProcess::(_processLogs) (26) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:00,031::__init__::225::IOProcess::(_processLogs) (26) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:00,031::__init__::225::IOProcess::(_processLogs) DEBUG|(26) Building response >Thread-29::DEBUG::2014-08-12 16:39:00,032::__init__::225::IOProcess::(_processLogs) (26) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:00,032::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:39:00,033::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:39:00,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-08-12 16:39:00,043::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.0010811 s, 326 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:00,044::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:00,044::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:00,045::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:00,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:00,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:00,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:00,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:00,045::__init__::225::IOProcess::(_processLogs) (27) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:00,046::__init__::225::IOProcess::(_processLogs) (27) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:00,046::__init__::225::IOProcess::(_processLogs) DEBUG|(27) Building response >Thread-29::DEBUG::2014-08-12 16:39:00,047::__init__::225::IOProcess::(_processLogs) (27) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:00,047::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:39:00,048::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-15::DEBUG::2014-08-12 16:39:00,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`5129d2fb-445b-4a01-812c-8252a0b4511f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:39:00,082::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:39:00,083::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434469', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475475', 'lastCheck': '8.3', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010811', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:39:00,083::task::1191::Storage.TaskManager.Task::(prepare) Task=`5129d2fb-445b-4a01-812c-8252a0b4511f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434469', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475475', 'lastCheck': '8.3', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010811', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:39:00,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`5129d2fb-445b-4a01-812c-8252a0b4511f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:39:00,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:39:00,083::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:39:00,083::task::993::Storage.TaskManager.Task::(_decref) Task=`5129d2fb-445b-4a01-812c-8252a0b4511f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:39:01,740::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:39:01,748::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602827 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:39:01,921::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:39:01,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000557576 s, 7.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:10,049::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:10,049::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:10,049::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:10,050::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:10,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:10,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:10,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:10,050::__init__::225::IOProcess::(_processLogs) (28) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:10,050::__init__::225::IOProcess::(_processLogs) (28) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:10,051::__init__::225::IOProcess::(_processLogs) DEBUG|(28) Building response >Thread-31::DEBUG::2014-08-12 16:39:10,052::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:39:10,053::__init__::225::IOProcess::(_processLogs) (28) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:10,061::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:39:10,062::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:39:10,063::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000502873 s, 700 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:10,064::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:10,064::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:10,064::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:10,065::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:10,065::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:10,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:10,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:10,065::__init__::225::IOProcess::(_processLogs) (29) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:10,065::__init__::225::IOProcess::(_processLogs) (29) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:10,066::__init__::225::IOProcess::(_processLogs) DEBUG|(29) Building response >Thread-29::DEBUG::2014-08-12 16:39:10,067::__init__::225::IOProcess::(_processLogs) (29) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:10,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:39:10,068::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:39:11,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:39:11,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000463299 s, 8.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:39:11,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:39:11,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648903 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:39:15,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`885fd6ce-68b4-4fdc-9e52-6348d8504e4f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:39:15,198::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:39:15,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648903', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463299', 'lastCheck': '3.4', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502873', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:39:15,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`885fd6ce-68b4-4fdc-9e52-6348d8504e4f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648903', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463299', 'lastCheck': '3.4', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502873', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:39:15,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`885fd6ce-68b4-4fdc-9e52-6348d8504e4f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:39:15,199::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:39:15,199::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:39:15,199::task::993::Storage.TaskManager.Task::(_decref) Task=`885fd6ce-68b4-4fdc-9e52-6348d8504e4f`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:39:20,068::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:20,069::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:20,069::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:20,069::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:20,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:20,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:20,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:20,070::__init__::225::IOProcess::(_processLogs) (30) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:20,070::__init__::225::IOProcess::(_processLogs) (30) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:20,070::__init__::225::IOProcess::(_processLogs) DEBUG|(30) Building response >Thread-29::DEBUG::2014-08-12 16:39:20,070::__init__::225::IOProcess::(_processLogs) (30) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:20,071::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-31::DEBUG::2014-08-12 16:39:20,072::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:39:20,073::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:39:20,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000610213 s, 577 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:20,083::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:20,083::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:20,083::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:20,083::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:20,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:20,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:20,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:20,084::__init__::225::IOProcess::(_processLogs) (31) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:20,084::__init__::225::IOProcess::(_processLogs) (31) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:20,085::__init__::225::IOProcess::(_processLogs) DEBUG|(31) Building response >Thread-29::DEBUG::2014-08-12 16:39:20,085::__init__::225::IOProcess::(_processLogs) (31) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:20,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:39:20,086::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:39:21,763::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:39:21,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000534779 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:39:21,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:39:21,950::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574265 s, 7.1 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:30,087::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:30,087::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:30,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:30,088::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:30,089::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-31::DEBUG::2014-08-12 16:39:30,089::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:39:30,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:30,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:30,099::__init__::225::IOProcess::(_processLogs) (32) Finding callback 'statvfs'... >Thread-31::DEBUG::2014-08-12 16:39:30,099::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000374878 s, 939 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:30,101::__init__::225::IOProcess::(_processLogs) (32) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:30,102::__init__::225::IOProcess::(_processLogs) (32) Building response >Thread-29::DEBUG::2014-08-12 16:39:30,102::__init__::225::IOProcess::(_processLogs) (32) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:30,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:39:30,102::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-29::DEBUG::2014-08-12 16:39:30,102::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:30,103::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:30,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:30,103::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:30,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:30,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:30,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:30,104::__init__::225::IOProcess::(_processLogs) (33) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:30,104::__init__::225::IOProcess::(_processLogs) (33) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:30,104::__init__::225::IOProcess::(_processLogs) (33) Building response >Thread-29::DEBUG::2014-08-12 16:39:30,104::__init__::225::IOProcess::(_processLogs) (33) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:30,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:39:30,105::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 317 >Thread-15::DEBUG::2014-08-12 16:39:30,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bf084d0-57d6-45e4-802b-aecd354badf7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:39:30,339::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:39:30,339::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574265', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534779', 'lastCheck': '8.6', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374878', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:39:30,339::task::1191::Storage.TaskManager.Task::(prepare) Task=`6bf084d0-57d6-45e4-802b-aecd354badf7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574265', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534779', 'lastCheck': '8.6', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374878', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:39:30,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bf084d0-57d6-45e4-802b-aecd354badf7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:39:30,340::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:39:30,340::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:39:30,340::task::993::Storage.TaskManager.Task::(_decref) Task=`6bf084d0-57d6-45e4-802b-aecd354badf7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:39:31,775::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:39:31,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000487824 s, 8.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:39:31,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:39:31,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661796 s, 6.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:40,107::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:40,107::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:40,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:40,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:40,108::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:40,108::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:40,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:40,108::__init__::225::IOProcess::(_processLogs) (34) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:40,108::__init__::225::IOProcess::(_processLogs) (34) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:40,109::__init__::225::IOProcess::(_processLogs) DEBUG|(34) Building response >Thread-29::DEBUG::2014-08-12 16:39:40,110::__init__::225::IOProcess::(_processLogs) (34) Queuing response >Thread-31::DEBUG::2014-08-12 16:39:40,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:39:40,111::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:39:40,119::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:39:40,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00146444 s, 240 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:40,123::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:40,124::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:40,124::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:40,124::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:40,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:40,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:40,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:40,125::__init__::225::IOProcess::(_processLogs) (35) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:40,125::__init__::225::IOProcess::(_processLogs) (35) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:40,125::__init__::225::IOProcess::(_processLogs) DEBUG|(35) Building response >Thread-29::DEBUG::2014-08-12 16:39:40,125::__init__::225::IOProcess::(_processLogs) (35) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:40,126::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:39:40,127::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:39:41,786::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:39:41,793::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734337 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:39:41,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:39:41,971::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000804272 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:39:45,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`074addc0-5558-493e-be02-75578c9ec3eb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:39:45,448::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:39:45,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804272', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734337', 'lastCheck': '3.7', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146444', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:39:45,448::task::1191::Storage.TaskManager.Task::(prepare) Task=`074addc0-5558-493e-be02-75578c9ec3eb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804272', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734337', 'lastCheck': '3.7', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146444', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:39:45,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`074addc0-5558-493e-be02-75578c9ec3eb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:39:45,449::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:39:45,449::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:39:45,449::task::993::Storage.TaskManager.Task::(_decref) Task=`074addc0-5558-493e-be02-75578c9ec3eb`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:39:50,128::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:50,129::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:50,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:50,129::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:50,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:50,129::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:50,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:50,130::__init__::225::IOProcess::(_processLogs) (36) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:50,130::__init__::225::IOProcess::(_processLogs) (36) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:50,130::__init__::225::IOProcess::(_processLogs) (36) Building response >Thread-29::DEBUG::2014-08-12 16:39:50,130::__init__::225::IOProcess::(_processLogs) (36) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:50,131::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-31::DEBUG::2014-08-12 16:39:50,132::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:39:50,132::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:39:50,141::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000643808 s, 547 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:39:50,142::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:39:50,142::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:39:50,143::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:39:50,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:39:50,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:39:50,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:39:50,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:39:50,143::__init__::225::IOProcess::(_processLogs) (37) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:39:50,144::__init__::225::IOProcess::(_processLogs) (37) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:39:50,144::__init__::225::IOProcess::(_processLogs) DEBUG|(37) Building response >Thread-29::DEBUG::2014-08-12 16:39:50,145::__init__::225::IOProcess::(_processLogs) (37) Queuing response >Thread-29::DEBUG::2014-08-12 16:39:50,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:39:50,146::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:39:51,797::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:39:51,804::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00054686 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:39:51,973::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:39:51,983::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597487 s, 6.9 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:00,147::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:00,147::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:00,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:00,147::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:00,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:00,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:00,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:00,148::__init__::225::IOProcess::(_processLogs) (38) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:00,148::__init__::225::IOProcess::(_processLogs) (38) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:00,149::__init__::225::IOProcess::(_processLogs) DEBUG|(38) Building response >Thread-29::DEBUG::2014-08-12 16:40:00,150::__init__::225::IOProcess::(_processLogs) (38) Queuing response >Thread-31::DEBUG::2014-08-12 16:40:00,150::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:40:00,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:00,159::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:40:00,161::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000341018 s, 1.0 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:00,162::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:00,162::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:00,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:00,162::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:00,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:00,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:00,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:00,163::__init__::225::IOProcess::(_processLogs) (39) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:00,163::__init__::225::IOProcess::(_processLogs) (39) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:00,164::__init__::225::IOProcess::(_processLogs) DEBUG|(39) Building response >Thread-29::DEBUG::2014-08-12 16:40:00,164::__init__::225::IOProcess::(_processLogs) (39) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:00,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:00,166::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-15::DEBUG::2014-08-12 16:40:00,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`80993a22-c325-422b-ae2f-3c73c40ad5a0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:40:00,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:40:00,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597487', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054686', 'lastCheck': '8.8', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341018', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:40:00,559::task::1191::Storage.TaskManager.Task::(prepare) Task=`80993a22-c325-422b-ae2f-3c73c40ad5a0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597487', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054686', 'lastCheck': '8.8', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341018', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:40:00,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`80993a22-c325-422b-ae2f-3c73c40ad5a0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:40:00,559::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:40:00,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:40:00,559::task::993::Storage.TaskManager.Task::(_decref) Task=`80993a22-c325-422b-ae2f-3c73c40ad5a0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:40:01,808::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:40:01,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067259 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:01,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:01,996::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607296 s, 6.7 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:10,166::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:10,167::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:10,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:10,167::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:10,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:10,167::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:10,167::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:10,168::__init__::225::IOProcess::(_processLogs) (40) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:10,168::__init__::225::IOProcess::(_processLogs) (40) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:10,168::__init__::225::IOProcess::(_processLogs) DEBUG|(40) Building response >Thread-29::DEBUG::2014-08-12 16:40:10,169::__init__::225::IOProcess::(_processLogs) (40) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:10,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:10,171::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:40:10,171::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-08-12 16:40:10,184::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000905958 s, 389 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:10,185::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:10,185::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:10,185::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:10,186::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:10,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:10,186::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:10,186::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:10,186::__init__::225::IOProcess::(_processLogs) (41) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:10,186::__init__::225::IOProcess::(_processLogs) (41) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:10,187::__init__::225::IOProcess::(_processLogs) DEBUG|(41) Building response >Thread-29::DEBUG::2014-08-12 16:40:10,188::__init__::225::IOProcess::(_processLogs) (41) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:10,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:10,189::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:40:11,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:40:11,830::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631889 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:11,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:12,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692086 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:40:15,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9789ca7-cc2f-4bd9-86e3-ffc000786adf`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:40:15,672::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:40:15,672::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692086', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631889', 'lastCheck': '3.8', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000905958', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:40:15,672::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9789ca7-cc2f-4bd9-86e3-ffc000786adf`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692086', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631889', 'lastCheck': '3.8', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000905958', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:40:15,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9789ca7-cc2f-4bd9-86e3-ffc000786adf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:40:15,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:40:15,673::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:40:15,673::task::993::Storage.TaskManager.Task::(_decref) Task=`e9789ca7-cc2f-4bd9-86e3-ffc000786adf`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:40:20,190::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:20,190::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:20,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:20,190::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:20,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:20,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:20,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:20,191::__init__::225::IOProcess::(_processLogs) (42) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:20,191::__init__::225::IOProcess::(_processLogs) (42) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:20,192::__init__::225::IOProcess::(_processLogs) DEBUG|(42) Building response >Thread-31::DEBUG::2014-08-12 16:40:20,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:40:20,193::__init__::225::IOProcess::(_processLogs) (42) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:20,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:20,203::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:40:20,204::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000708921 s, 497 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:20,204::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:20,204::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:20,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:20,205::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:20,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:20,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:20,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:20,205::__init__::225::IOProcess::(_processLogs) (43) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:20,206::__init__::225::IOProcess::(_processLogs) (43) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:20,206::__init__::225::IOProcess::(_processLogs) DEBUG|(43) Building response >Thread-29::DEBUG::2014-08-12 16:40:20,207::__init__::225::IOProcess::(_processLogs) (43) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:20,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:20,208::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:40:21,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:40:21,842::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726167 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:22,008::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:22,017::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631755 s, 6.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:30,209::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:30,209::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:30,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:30,209::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:30,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:30,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:30,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:30,210::__init__::225::IOProcess::(_processLogs) (44) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:30,210::__init__::225::IOProcess::(_processLogs) (44) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:30,210::__init__::225::IOProcess::(_processLogs) (44) Building response >Thread-29::DEBUG::2014-08-12 16:40:30,210::__init__::225::IOProcess::(_processLogs) (44) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:30,211::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:40:30,212::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:40:30,212::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-08-12 16:40:30,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000398084 s, 884 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:30,222::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:30,222::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:30,223::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:30,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:30,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:30,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:30,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:30,223::__init__::225::IOProcess::(_processLogs) (45) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:30,224::__init__::225::IOProcess::(_processLogs) (45) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:30,224::__init__::225::IOProcess::(_processLogs) DEBUG|(45) Building response >Thread-29::DEBUG::2014-08-12 16:40:30,225::__init__::225::IOProcess::(_processLogs) (45) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:30,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:30,226::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-15::DEBUG::2014-08-12 16:40:30,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`efec2008-f82d-4673-933e-876cf5f9ac28`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:40:30,777::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:40:30,777::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631755', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726167', 'lastCheck': '8.9', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398084', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:40:30,777::task::1191::Storage.TaskManager.Task::(prepare) Task=`efec2008-f82d-4673-933e-876cf5f9ac28`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631755', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726167', 'lastCheck': '8.9', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398084', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:40:30,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`efec2008-f82d-4673-933e-876cf5f9ac28`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:40:30,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:40:30,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:40:30,778::task::993::Storage.TaskManager.Task::(_decref) Task=`efec2008-f82d-4673-933e-876cf5f9ac28`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:40:31,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:40:31,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00972279 s, 421 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:32,018::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:32,026::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660019 s, 6.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:40,227::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:40,227::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:40,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:40,227::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:40,227::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:40,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:40,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:40,228::__init__::225::IOProcess::(_processLogs) (46) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:40,228::__init__::225::IOProcess::(_processLogs) (46) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:40,229::__init__::225::IOProcess::(_processLogs) DEBUG|(46) Building response >Thread-31::DEBUG::2014-08-12 16:40:40,230::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:40:40,230::__init__::225::IOProcess::(_processLogs) (46) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:40,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:40,241::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-31::DEBUG::2014-08-12 16:40:40,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000969784 s, 363 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:40:40,243::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:40,243::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:40:40,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:40,244::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:40,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:40,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:40,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:40,244::__init__::225::IOProcess::(_processLogs) (47) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:40:40,244::__init__::225::IOProcess::(_processLogs) (47) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:40:40,245::__init__::225::IOProcess::(_processLogs) (47) Building response >Thread-29::DEBUG::2014-08-12 16:40:40,245::__init__::225::IOProcess::(_processLogs) (47) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:40,245::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:40:40,246::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-15::DEBUG::2014-08-12 16:40:40,787::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:40:40,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f51dc5-b2fc-4db0-ba7d-251b64a9d1b7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:40:40,788::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'attached'}, options=None) >Thread-15::DEBUG::2014-08-12 16:40:40,788::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`77f0362a-932c-43ed-ab13-35fe2a3b93be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:40:40,788::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:40:40,788::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:40:40,789::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`77f0362a-932c-43ed-ab13-35fe2a3b93be`::Granted request >Thread-15::DEBUG::2014-08-12 16:40:40,789::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`90a9333e-9133-4d8e-96ac-9c29fc5b9dfe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:40:40,789::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:40:40,790::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:40:40,790::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`90a9333e-9133-4d8e-96ac-9c29fc5b9dfe`::Granted request >Thread-15::DEBUG::2014-08-12 16:40:40,790::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'attached'} >Thread-15::INFO::2014-08-12 16:40:40,790::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'Attached'} >Thread-15::DEBUG::2014-08-12 16:40:40,790::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,791::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,791::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,791::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,791::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,792::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,792::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:40:40,792::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:40:40,792::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:40:40,792::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:40:40,792::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:40:40,793::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:40,814::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:40:40,823::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:40,922::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:40:40,923::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,923::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,923::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,923::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,924::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,924::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,924::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:40:40,924::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:40,927::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:41,235::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:40:41,236::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:41,236::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:40:41,237::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:41,245::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000608035 s, 3.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:40:41,245::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000608035 s, 3.4 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:40:41,245::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:40:41,246::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:40:41,246::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:40:41,246::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:41,246::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:41,247::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:41,247::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:41,247::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:41,247::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:41,426::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:40:41,427::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:41,427::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:40:41,428::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:40:41,428::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:40:41,429::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:40:41,429::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 16:40:41,429::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:40:41,429::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 16:40:41,429::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-31::DEBUG::2014-08-12 16:40:41,430::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:40:41,431::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:41,432::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:40:41,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:41,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:41,432::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:41,432::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:41,432::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:41,432::__init__::225::IOProcess::(_processLogs) (48) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:40:41,433::__init__::225::IOProcess::(_processLogs) (48) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:40:41,433::__init__::225::IOProcess::(_processLogs) (48) Building response >Thread-29::DEBUG::2014-08-12 16:40:41,433::__init__::225::IOProcess::(_processLogs) (48) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:41,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:41,434::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 198 >Thread-31::DEBUG::2014-08-12 16:40:41,437::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:40:41,437::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:40:41,438::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 16:40:41,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:41,438::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:41,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:41,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:41,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:41,439::__init__::225::IOProcess::(_processLogs) (49) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:40:41,439::__init__::225::IOProcess::(_processLogs) (49) Got request for method 'touch' >Thread-31::DEBUG::2014-08-12 16:40:41,439::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:40:41,439::__init__::225::IOProcess::(_processLogs) (49) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:41,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:41,441::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:40:41,441::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:40:41,441::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:41,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:41,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:41,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:41,442::__init__::225::IOProcess::(_processLogs) (50) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:40:41,442::__init__::225::IOProcess::(_processLogs) (50) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:40:41,442::__init__::225::IOProcess::(_processLogs) (50) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:41,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-31::DEBUG::2014-08-12 16:40:41,443::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=673835d8db3efe8685ee06bbf6bd04fd56d8e345'] >Thread-29::DEBUG::2014-08-12 16:40:41,443::__init__::225::IOProcess::(_processLogs) Sending response sized 542 >Thread-29::DEBUG::2014-08-12 16:40:41,445::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 16:40:41,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:41,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:41,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:41,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:41,446::__init__::225::IOProcess::(_processLogs) (51) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:40:41,446::__init__::225::IOProcess::(_processLogs) (51) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:40:41,446::__init__::225::IOProcess::(_processLogs) (51) Building response >Thread-29::DEBUG::2014-08-12 16:40:41,446::__init__::225::IOProcess::(_processLogs) (51) Queuing response >Thread-29::DEBUG::2014-08-12 16:40:41,447::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:41,447::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:40:41,447::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-29::DEBUG::2014-08-12 16:40:41,448::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:40:41,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:41,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:41,448::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:41,448::__init__::225::IOProcess::(_processLogs) (52) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:40:41,448::__init__::225::IOProcess::(_processLogs) (52) Got request for method 'glob' >Thread-31::DEBUG::2014-08-12 16:40:41,449::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 16:40:41,449::__init__::225::IOProcess::(_processLogs) (52) Queuing response >Thread-31::INFO::2014-08-12 16:40:41,449::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-29::DEBUG::2014-08-12 16:40:41,450::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-31::INFO::2014-08-12 16:40:41,450::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-29::DEBUG::2014-08-12 16:40:41,451::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-31::INFO::2014-08-12 16:40:41,451::clusterlock::206::Storage.SANLock::(releaseHostId) Releasing host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 (id: 1) >Thread-17::DEBUG::2014-08-12 16:40:41,865::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:42,029::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:42,029::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 16:40:42,038::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:40:42,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:40:42,048::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000744312 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:42,210::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:42,210::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:42,210::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:40:42,211::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:42,219::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000557219 s, 3.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:42,220::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000557219 s, 3.7 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:40:42,220::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:40:42,220::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:40:42,220::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:40:42,220::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:42,221::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:42,221::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:42,221::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:42,221::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:42,222::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:42,405::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:42,405::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:42,406::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:40:42,407::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:40:42,407::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:40:42,407::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:40:42,407::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:42,575::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:42,576::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:42,585::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554953 s, 7.4 MB/s\n'; <rc> = 0 >Thread-31::DEBUG::2014-08-12 16:40:44,453::clusterlock::216::Storage.SANLock::(releaseHostId) Host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 released successfully (id: 1) >Thread-15::DEBUG::2014-08-12 16:40:44,453::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` stopped monitoring domain `0adb6530-ef5f-41f0-8655-a7ca83123c87` >Thread-15::DEBUG::2014-08-12 16:40:44,454::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:40:44,454::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:40:44,454::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 16:40:44,454::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:44,455::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:44,621::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:40:44,622::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:44,622::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:40:44,622::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:40:44,622::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:40:44,622::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:40:44,624::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:40:44,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:40:44,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:40:44,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:40:44,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:40:44,625::__init__::225::IOProcess::(_processLogs) (53) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:40:44,625::__init__::225::IOProcess::(_processLogs) (53) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:40:44,626::__init__::225::IOProcess::(_processLogs) (53) Queuing response >Thread-15::INFO::2014-08-12 16:40:44,627::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 16:40:44,627::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:40:44,628::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-15::DEBUG::2014-08-12 16:40:44,628::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 16:40:44,629::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 16:40:44,629::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:40:44,629::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 16:40:44,629::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 16:40:44,629::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 16:40:44,630::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:40:44,630::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:40:44,630::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:40:44,630::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:40:44,631::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:40:44,631::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:40:44,631::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:40:44,631::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:40:44,632::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:40:44,632::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:40:44,632::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:40:44,632::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:40:44,632::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0f51dc5-b2fc-4db0-ba7d-251b64a9d1b7`::finished: True >Thread-15::DEBUG::2014-08-12 16:40:44,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f51dc5-b2fc-4db0-ba7d-251b64a9d1b7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:40:44,633::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:40:44,633::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:40:44,633::task::993::Storage.TaskManager.Task::(_decref) Task=`c0f51dc5-b2fc-4db0-ba7d-251b64a9d1b7`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:40:44,648::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [761b6694] >Thread-15::DEBUG::2014-08-12 16:40:44,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`8012843f-2530-4511-a647-8d8f9fe07517`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:40:44,649::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:40:44,649::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:44,685::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:40:44,686::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:40:44,686::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:40:44,686::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:40:44,686::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:40:44,687::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:44,708::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:40:44,709::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:40:44,758::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:40:44,758::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:44,759::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:44,759::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:44,759::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:44,759::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:44,760::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:40:44,760::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 16:40:44,760::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:40:44,760::task::1191::Storage.TaskManager.Task::(prepare) Task=`8012843f-2530-4511-a647-8d8f9fe07517`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:40:44,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`8012843f-2530-4511-a647-8d8f9fe07517`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:40:44,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:40:44,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:40:44,761::task::993::Storage.TaskManager.Task::(_decref) Task=`8012843f-2530-4511-a647-8d8f9fe07517`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:40:45,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`000a14f9-e323-4522-9bc6-d16d2e953fc9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:40:45,894::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:40:45,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554953', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744312', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:40:45,894::task::1191::Storage.TaskManager.Task::(prepare) Task=`000a14f9-e323-4522-9bc6-d16d2e953fc9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554953', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744312', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:40:45,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`000a14f9-e323-4522-9bc6-d16d2e953fc9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:40:45,894::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:40:45,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:40:45,895::task::993::Storage.TaskManager.Task::(_decref) Task=`000a14f9-e323-4522-9bc6-d16d2e953fc9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:40:52,051::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:40:52,054::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:40:52,248::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:40:52,249::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:40:52,249::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:40:52,258::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558815 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:52,587::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:52,589::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:52,779::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:40:52,781::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:40:52,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:40:52,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676249 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:01,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`a823bae4-aaf3-4a34-ad38-09839199a7ed`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:41:01,006::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:41:01,007::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676249', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558815', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:41:01,007::task::1191::Storage.TaskManager.Task::(prepare) Task=`a823bae4-aaf3-4a34-ad38-09839199a7ed`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676249', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558815', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:41:01,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`a823bae4-aaf3-4a34-ad38-09839199a7ed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:41:01,007::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:41:01,007::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:41:01,007::task::993::Storage.TaskManager.Task::(_decref) Task=`a823bae4-aaf3-4a34-ad38-09839199a7ed`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:41:02,262::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:02,273::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609585 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:02,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:02,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660354 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:12,275::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [1f8d1bf1] >Thread-15::DEBUG::2014-08-12 16:41:12,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`c32f6c7d-9802-4e38-99a3-48e7621c1236`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:41:12,276::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:41:12,278::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 16:41:12,279::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=6,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:12,288::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:12,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626949 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:12,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:12,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648088 s, 6.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-12 16:41:16,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`5144e2d5-9d46-4f3d-80af-9b47af10d9c2`::moving from state init -> state preparing >Thread-28::INFO::2014-08-12 16:41:16,124::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-08-12 16:41:16,125::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648088', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626949', 'lastCheck': '3.8', 'valid': True}} >Thread-28::DEBUG::2014-08-12 16:41:16,125::task::1191::Storage.TaskManager.Task::(prepare) Task=`5144e2d5-9d46-4f3d-80af-9b47af10d9c2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648088', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626949', 'lastCheck': '3.8', 'valid': True}} >Thread-28::DEBUG::2014-08-12 16:41:16,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`5144e2d5-9d46-4f3d-80af-9b47af10d9c2`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-08-12 16:41:16,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-08-12 16:41:16,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-08-12 16:41:16,126::task::993::Storage.TaskManager.Task::(_decref) Task=`5144e2d5-9d46-4f3d-80af-9b47af10d9c2`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:41:17,343::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-29::DEBUG::2014-08-12 16:41:17,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:41:17,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:41:17,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:41:17,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:41:17,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:41:17,344::__init__::225::IOProcess::(_processLogs) (54) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:41:17,344::__init__::225::IOProcess::(_processLogs) (54) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:41:17,345::__init__::225::IOProcess::(_processLogs) (54) Queuing response >Thread-29::DEBUG::2014-08-12 16:41:17,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:41:17,346::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-15::DEBUG::2014-08-12 16:41:17,353::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:41:17,353::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:41:17,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:41:17,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:41:17,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:41:17,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:41:17,354::__init__::225::IOProcess::(_processLogs) (55) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:41:17,354::__init__::225::IOProcess::(_processLogs) (55) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 16:41:17,355::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-29::DEBUG::2014-08-12 16:41:17,355::__init__::225::IOProcess::(_processLogs) (55) Queuing response >Thread-15::DEBUG::2014-08-12 16:41:17,356::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 16:41:17,357::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-29::DEBUG::2014-08-12 16:41:17,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 16:41:17,358::task::1191::Storage.TaskManager.Task::(prepare) Task=`c32f6c7d-9802-4e38-99a3-48e7621c1236`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:41:17,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`c32f6c7d-9802-4e38-99a3-48e7621c1236`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 16:41:17,359::__init__::225::IOProcess::(_processLogs) Sending response sized 191 >Thread-15::DEBUG::2014-08-12 16:41:17,359::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:41:17,360::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:41:17,360::task::993::Storage.TaskManager.Task::(_decref) Task=`c32f6c7d-9802-4e38-99a3-48e7621c1236`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:41:17,593::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:41:17,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`056dc8b2-9a35-4e78-a7ab-fdf0fe1bf295`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:41:17,593::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 16:41:17,594::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`feb07c09-ccd5-44c2-aca4-9a48f04a609b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:41:17,594::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:41:17,594::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:41:17,594::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`feb07c09-ccd5-44c2-aca4-9a48f04a609b`::Granted request >Thread-15::DEBUG::2014-08-12 16:41:17,595::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a5c4d7a1-7576-4a55-90c2-989d1c7f2de5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:41:17,595::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:41:17,595::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:41:17,595::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`a5c4d7a1-7576-4a55-90c2-989d1c7f2de5`::Granted request >Thread-15::DEBUG::2014-08-12 16:41:17,596::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 16:41:17,596::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::DEBUG::2014-08-12 16:41:17,596::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,596::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,596::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,597::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,597::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,597::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,597::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:41:17,598::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:41:17,598::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:41:17,598::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:41:17,598::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:41:17,598::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:17,621::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:41:17,623::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:17,708::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:17,708::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,709::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,709::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,709::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,709::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,709::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,710::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:41:17,710::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,713::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:17,989::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:17,990::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:17,990::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:41:17,991::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:17,998::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000490439 s, 4.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:17,999::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000490439 s, 4.2 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:41:17,999::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:41:17,999::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:41:17,999::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:41:18,000::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,000::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,000::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,000::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,000::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,001::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:18,187::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:18,188::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,188::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:41:18,189::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:41:18,189::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:41:18,189::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:41:18,190::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 16:41:18,190::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:41:18,190::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:41:18,190::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:41:18,190::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:41:18,191::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 16:41:18,191::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,191::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:18,371::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:18,372::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,372::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:41:18,372::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:41:18,372::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:41:18,372::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:41:18,374::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:41:18,374::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:41:18,374::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:41:18,374::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:41:18,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:41:18,375::__init__::225::IOProcess::(_processLogs) (56) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:41:18,375::__init__::225::IOProcess::(_processLogs) (56) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:41:18,375::__init__::225::IOProcess::(_processLogs) (56) Queuing response >Thread-29::DEBUG::2014-08-12 16:41:18,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:41:18,376::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-15::INFO::2014-08-12 16:41:18,376::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 16:41:18,377::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 16:41:18,377::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 16:41:18,378::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:41:18,378::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 16:41:18,378::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 16:41:18,378::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 16:41:18,378::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:41:18,379::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:41:18,379::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:41:18,379::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:41:18,380::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:41:18,380::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:41:18,380::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:41:18,380::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:41:18,380::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:41:18,380::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:41:18,381::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:41:18,381::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:41:18,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`056dc8b2-9a35-4e78-a7ab-fdf0fe1bf295`::finished: True >Thread-15::DEBUG::2014-08-12 16:41:18,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`056dc8b2-9a35-4e78-a7ab-fdf0fe1bf295`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:41:18,381::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:41:18,381::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:41:18,382::task::993::Storage.TaskManager.Task::(_decref) Task=`056dc8b2-9a35-4e78-a7ab-fdf0fe1bf295`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:41:18,395::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5ef32ce6] >Thread-15::DEBUG::2014-08-12 16:41:18,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa22a324-db8c-40e0-8128-dd1f8f026bb4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:41:18,396::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:41:18,396::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:18,436::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:41:18,436::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:41:18,437::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:41:18,437::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:41:18,437::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:41:18,437::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:18,462::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:41:18,470::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:41:18,517::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:18,518::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,518::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,518::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,518::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,519::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,519::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:41:18,519::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 16:41:18,519::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:41:18,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa22a324-db8c-40e0-8128-dd1f8f026bb4`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:41:18,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa22a324-db8c-40e0-8128-dd1f8f026bb4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:41:18,520::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:41:18,520::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:41:18,520::task::993::Storage.TaskManager.Task::(_decref) Task=`aa22a324-db8c-40e0-8128-dd1f8f026bb4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:41:22,308::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:22,511::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:41:22,516::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:22,529::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639677 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:41:22,535::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:41:22,539::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:22,725::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:41:22,727::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:22,815::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:22,816::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:23,004::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:23,005::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:23,006::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:41:23,007::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:23,016::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000524789 s, 3.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:23,016::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000524789 s, 3.9 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:41:23,017::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:41:23,018::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:41:23,019::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:41:23,020::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:23,022::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:23,023::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:23,024::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:23,026::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:23,027::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:23,210::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:23,211::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:41:23,212::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:41:23,214::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:41:23,215::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:41:23,215::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:41:23,216::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:23,384::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:23,385::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:23,392::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589413 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:31,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`80af0c01-45e7-47ff-98e3-c8856e23233c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:41:31,353::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:41:31,353::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589413', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639677', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:41:31,353::task::1191::Storage.TaskManager.Task::(prepare) Task=`80af0c01-45e7-47ff-98e3-c8856e23233c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589413', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639677', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:41:31,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`80af0c01-45e7-47ff-98e3-c8856e23233c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:41:31,353::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:41:31,354::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:41:31,354::task::993::Storage.TaskManager.Task::(_decref) Task=`80af0c01-45e7-47ff-98e3-c8856e23233c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:41:32,740::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:32,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596822 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:33,394::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:33,403::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000584225 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:41:42,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:42,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000549726 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:43,412::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:43,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622679 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:41:46,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8d1c0c2-cebf-4171-ae28-85e404949a04`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:41:46,580::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:41:46,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622679', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549726', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:41:46,580::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8d1c0c2-cebf-4171-ae28-85e404949a04`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622679', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549726', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:41:46,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8d1c0c2-cebf-4171-ae28-85e404949a04`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:41:46,580::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:41:46,581::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:41:46,581::task::993::Storage.TaskManager.Task::(_decref) Task=`c8d1c0c2-cebf-4171-ae28-85e404949a04`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:41:52,766::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:41:52,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645572 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:41:53,422::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:41:53,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582049 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:01,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`3af42eef-dfeb-4970-a8a9-9e7785b4ef75`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:42:01,704::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:42:01,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582049', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645572', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:42:01,705::task::1191::Storage.TaskManager.Task::(prepare) Task=`3af42eef-dfeb-4970-a8a9-9e7785b4ef75`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582049', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645572', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:42:01,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`3af42eef-dfeb-4970-a8a9-9e7785b4ef75`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:42:01,705::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:42:01,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:42:01,705::task::993::Storage.TaskManager.Task::(_decref) Task=`3af42eef-dfeb-4970-a8a9-9e7785b4ef75`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:42:02,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:42:02,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706704 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:03,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:03,439::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644158 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:42:12,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:42:12,830::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056314 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:13,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:13,449::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765862 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:16,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e6fe62b-ab4f-4ce4-908f-21f6467bbac2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:42:16,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:42:16,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765862', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056314', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:42:16,848::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e6fe62b-ab4f-4ce4-908f-21f6467bbac2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765862', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056314', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:42:16,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e6fe62b-ab4f-4ce4-908f-21f6467bbac2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:42:16,848::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:42:16,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:42:16,849::task::993::Storage.TaskManager.Task::(_decref) Task=`6e6fe62b-ab4f-4ce4-908f-21f6467bbac2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:42:22,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:42:22,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705458 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:23,451::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:23,459::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608579 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:26,805::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [83a199c] >Thread-15::DEBUG::2014-08-12 16:42:26,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3632679-514e-41aa-aac8-7354aeeac241`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:42:26,806::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:42:26,808::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 16:42:26,809::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=3,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 16:42:26,859::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-29::DEBUG::2014-08-12 16:42:26,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:26,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:26,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:26,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:26,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:26,860::__init__::225::IOProcess::(_processLogs) (57) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:42:26,860::__init__::225::IOProcess::(_processLogs) (57) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:42:26,861::__init__::225::IOProcess::(_processLogs) DEBUG|(57) Building response >Thread-29::DEBUG::2014-08-12 16:42:26,861::__init__::225::IOProcess::(_processLogs) (57) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:26,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:26,862::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-15::DEBUG::2014-08-12 16:42:26,874::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:42:26,875::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:42:26,875::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:42:26,875::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:26,875::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:26,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:26,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:26,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:26,876::__init__::225::IOProcess::(_processLogs) (58) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:42:26,876::__init__::225::IOProcess::(_processLogs) (58) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:42:26,877::__init__::225::IOProcess::(_processLogs) DEBUG|(58) Building response >Thread-29::DEBUG::2014-08-12 16:42:26,877::__init__::225::IOProcess::(_processLogs) (58) Queuing response >Thread-15::DEBUG::2014-08-12 16:42:26,877::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-29::DEBUG::2014-08-12 16:42:26,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:26,878::__init__::225::IOProcess::(_processLogs) Sending response sized 191 >Thread-15::DEBUG::2014-08-12 16:42:26,878::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 16:42:26,879::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:42:26,879::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3632679-514e-41aa-aac8-7354aeeac241`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:42:26,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3632679-514e-41aa-aac8-7354aeeac241`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:42:26,879::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:42:26,880::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:42:26,880::task::993::Storage.TaskManager.Task::(_decref) Task=`d3632679-514e-41aa-aac8-7354aeeac241`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:42:27,028::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [716b97e9] >Thread-15::DEBUG::2014-08-12 16:42:27,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b1472da-cff2-44bb-bbf7-653548382b5b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:42:27,029::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='0adb6530-ef5f-41f0-8655-a7ca83123c87', options=None) >Thread-15::DEBUG::2014-08-12 16:42:27,029::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:42:27,029::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:42:27,030::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:42:27,030::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:42:27,030::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:42:27,030::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:27,058::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:42:27,059::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:27,141::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:27,141::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:27,141::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:27,142::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:27,142::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:27,142::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:27,142::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:27,143::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-29::DEBUG::2014-08-12 16:42:27,144::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:42:27,144::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:42:27,144::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:27,145::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:27,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:27,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:27,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:27,145::__init__::225::IOProcess::(_processLogs) (59) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:42:27,145::__init__::225::IOProcess::(_processLogs) (59) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:42:27,147::__init__::225::IOProcess::(_processLogs) DEBUG|(59) Building response >Thread-29::DEBUG::2014-08-12 16:42:27,147::__init__::225::IOProcess::(_processLogs) (59) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:27,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:27,148::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-15::DEBUG::2014-08-12 16:42:27,151::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:42:27,151::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:42:27,151::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 16:42:27,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:27,152::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:27,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:27,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:27,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:27,152::__init__::225::IOProcess::(_processLogs) (60) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:42:27,152::__init__::225::IOProcess::(_processLogs) (60) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 16:42:27,153::__init__::225::IOProcess::(_processLogs) DEBUG|(60) Building response >Thread-29::DEBUG::2014-08-12 16:42:27,154::__init__::225::IOProcess::(_processLogs) (60) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:27,154::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 16:42:27,154::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:42:27,155::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:42:27,156::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:42:27,157::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:42:27,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:27,157::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:27,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:27,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:27,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:27,158::__init__::225::IOProcess::(_processLogs) (61) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:42:27,158::__init__::225::IOProcess::(_processLogs) (61) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:42:27,158::__init__::225::IOProcess::(_processLogs) DEBUG|(61) Building response >Thread-29::DEBUG::2014-08-12 16:42:27,159::__init__::225::IOProcess::(_processLogs) (61) Queuing response >Thread-15::DEBUG::2014-08-12 16:42:27,159::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=674aee93c8b731bf0e42767249a6c48454b08d0e'] >Thread-29::DEBUG::2014-08-12 16:42:27,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:27,161::__init__::225::IOProcess::(_processLogs) Sending response sized 494 >Thread-29::DEBUG::2014-08-12 16:42:27,162::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 16:42:27,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:27,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:27,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:27,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:27,164::__init__::225::IOProcess::(_processLogs) (62) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:42:27,164::__init__::225::IOProcess::(_processLogs) (62) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:42:27,164::__init__::225::IOProcess::(_processLogs) (62) Building response >Thread-29::DEBUG::2014-08-12 16:42:27,164::__init__::225::IOProcess::(_processLogs) (62) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:27,164::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:27,165::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:42:27,165::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-29::DEBUG::2014-08-12 16:42:27,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:27,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:27,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:27,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:27,166::__init__::225::IOProcess::(_processLogs) (63) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:42:27,166::__init__::225::IOProcess::(_processLogs) (63) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:42:27,166::__init__::225::IOProcess::(_processLogs) (63) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:27,167::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-15::DEBUG::2014-08-12 16:42:27,167::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-15::INFO::2014-08-12 16:42:27,167::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-15::INFO::2014-08-12 16:42:27,168::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-15::INFO::2014-08-12 16:42:27,168::fileSD::339::Storage.StorageDomain::(validate) sdUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:42:27,168::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:42:27,168::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:27,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:27,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:27,169::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:27,169::__init__::225::IOProcess::(_processLogs) (64) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:42:27,169::__init__::225::IOProcess::(_processLogs) (64) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:42:27,169::__init__::225::IOProcess::(_processLogs) (64) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:27,170::__init__::225::IOProcess::(_processLogs) Sending response sized 494 >Thread-15::DEBUG::2014-08-12 16:42:27,170::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=674aee93c8b731bf0e42767249a6c48454b08d0e'] >Thread-15::DEBUG::2014-08-12 16:42:27,171::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87`ReqID=`f9114309-49f9-47fc-a9d8-0e28fa2bbe83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2806' at 'getStorageDomainInfo' >Thread-15::DEBUG::2014-08-12 16:42:27,171::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:42:27,172::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:42:27,172::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87`ReqID=`f9114309-49f9-47fc-a9d8-0e28fa2bbe83`::Granted request >Thread-15::DEBUG::2014-08-12 16:42:27,172::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b1472da-cff2-44bb-bbf7-653548382b5b`::_resourcesAcquired: Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87 (shared) >Thread-15::DEBUG::2014-08-12 16:42:27,172::task::993::Storage.TaskManager.Task::(_decref) Task=`4b1472da-cff2-44bb-bbf7-653548382b5b`::ref 1 aborting False >Thread-15::INFO::2014-08-12 16:42:27,174::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'0adb6530-ef5f-41f0-8655-a7ca83123c87', 'version': '3', 'role': 'Regular', 'remotePath': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'pNFS'}} >Thread-15::DEBUG::2014-08-12 16:42:27,175::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b1472da-cff2-44bb-bbf7-653548382b5b`::finished: {'info': {'uuid': u'0adb6530-ef5f-41f0-8655-a7ca83123c87', 'version': '3', 'role': 'Regular', 'remotePath': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'pNFS'}} >Thread-15::DEBUG::2014-08-12 16:42:27,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b1472da-cff2-44bb-bbf7-653548382b5b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:42:27,175::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87': < ResourceRef 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 16:42:27,175::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:42:27,175::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' >Thread-15::DEBUG::2014-08-12 16:42:27,175::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' (0 active users) >Thread-15::DEBUG::2014-08-12 16:42:27,176::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:42:27,176::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87', Clearing records. >Thread-15::DEBUG::2014-08-12 16:42:27,176::task::993::Storage.TaskManager.Task::(_decref) Task=`4b1472da-cff2-44bb-bbf7-653548382b5b`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:42:32,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5d8e8db-4c26-4f07-b43d-04058da301db`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:42:32,040::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:42:32,040::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608579', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705458', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:42:32,040::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5d8e8db-4c26-4f07-b43d-04058da301db`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608579', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705458', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:42:32,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5d8e8db-4c26-4f07-b43d-04058da301db`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:42:32,041::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:42:32,041::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:42:32,041::task::993::Storage.TaskManager.Task::(_decref) Task=`f5d8e8db-4c26-4f07-b43d-04058da301db`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:42:32,858::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:42:32,861::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:42:33,141::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:42:33,143::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:42:33,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:42:33,152::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552021 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:33,460::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:33,460::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:33,643::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:33,643::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:33,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:33,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601668 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:42:43,158::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:42:43,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630874 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:43,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:43,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661254 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:47,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`c473b3d2-290e-460a-a5fa-711936401527`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:42:47,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:42:47,158::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661254', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630874', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:42:47,158::task::1191::Storage.TaskManager.Task::(prepare) Task=`c473b3d2-290e-460a-a5fa-711936401527`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661254', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630874', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:42:47,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`c473b3d2-290e-460a-a5fa-711936401527`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:42:47,159::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:42:47,159::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:42:47,159::task::993::Storage.TaskManager.Task::(_decref) Task=`c473b3d2-290e-460a-a5fa-711936401527`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:42:52,592::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [472e7805] >Thread-15::DEBUG::2014-08-12 16:42:52,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dc9d092-a4aa-4e7f-8a77-ac2578ac3f85`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:42:52,594::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:42:52,601::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:42:52,602::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:42:52,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:52,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:52,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:52,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-15::DEBUG::2014-08-12 16:42:52,605::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-15::DEBUG::2014-08-12 16:42:52,607::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 16:42:52,607::__init__::225::IOProcess::(_processLogs) (65) Finding callback 'glob'... >Thread-15::INFO::2014-08-12 16:42:52,608::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-29::DEBUG::2014-08-12 16:42:52,608::__init__::225::IOProcess::(_processLogs) (65) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 16:42:52,609::task::1191::Storage.TaskManager.Task::(prepare) Task=`7dc9d092-a4aa-4e7f-8a77-ac2578ac3f85`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:42:52,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dc9d092-a4aa-4e7f-8a77-ac2578ac3f85`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 16:42:52,610::__init__::225::IOProcess::(_processLogs) (65) Building response >Thread-15::DEBUG::2014-08-12 16:42:52,610::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2014-08-12 16:42:52,611::__init__::225::IOProcess::(_processLogs) (65) Queuing response >Thread-15::DEBUG::2014-08-12 16:42:52,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-08-12 16:42:52,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 16:42:52,613::task::993::Storage.TaskManager.Task::(_decref) Task=`7dc9d092-a4aa-4e7f-8a77-ac2578ac3f85`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:42:52,614::__init__::225::IOProcess::(_processLogs) Sending response sized 191 >Thread-15::DEBUG::2014-08-12 16:42:52,849::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:42:52,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`e16a8703-eade-4700-8e4f-8e61fd5f5e85`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:42:52,851::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 16:42:52,854::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`330ab738-ebd8-4d92-b985-0e0794a0f595`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:42:52,855::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:42:52,855::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:42:52,856::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`330ab738-ebd8-4d92-b985-0e0794a0f595`::Granted request >Thread-15::DEBUG::2014-08-12 16:42:52,858::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`77d9b52b-cca9-4329-be3b-ab36859f4707`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:42:52,858::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:42:52,859::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:42:52,860::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`77d9b52b-cca9-4329-be3b-ab36859f4707`::Granted request >Thread-15::DEBUG::2014-08-12 16:42:52,861::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'active'} >Thread-15::INFO::2014-08-12 16:42:52,861::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'Active'} >Thread-15::DEBUG::2014-08-12 16:42:52,862::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,863::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,864::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,864::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,865::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,866::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,867::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:42:52,867::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:42:52,867::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:42:52,868::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:42:52,868::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:42:52,869::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:52,897::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:42:52,907::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:52,983::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:52,984::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,985::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,987::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,988::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,989::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,990::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:52,991::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:42:52,992::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:53,001::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:53,249::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:53,250::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:53,250::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:42:53,251::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:53,260::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000535311 s, 3.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:53,261::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000535311 s, 3.8 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:42:53,261::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:42:53,262::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:42:53,262::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:42:53,263::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:53,264::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:53,265::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:53,265::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:53,266::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:53,267::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:53,450::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:42:53,452::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:42:53,454::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:42:53,457::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:42:53,458::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:42:53,459::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:42:53,462::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-17::DEBUG::2014-08-12 16:42:53,463::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:53,464::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:42:53,474::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 16:42:53,476::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:42:53,478::sp::1410::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` started monitoring domain `0adb6530-ef5f-41f0-8655-a7ca83123c87` >Thread-40::DEBUG::2014-08-12 16:42:53,479::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:42:53,480::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:42:53,482::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:42:53,484::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-29::DEBUG::2014-08-12 16:42:53,487::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-15::DEBUG::2014-08-12 16:42:53,489::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-29::DEBUG::2014-08-12 16:42:53,489::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:53,492::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-15::DEBUG::2014-08-12 16:42:53,492::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf 0adb6530-ef5f-41f0-8655-a7ca83123c87 (cwd None) >Thread-29::DEBUG::2014-08-12 16:42:53,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:53,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:53,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:53,506::__init__::225::IOProcess::(_processLogs) (66) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:42:53,507::__init__::225::IOProcess::(_processLogs) (66) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:42:53,510::__init__::225::IOProcess::(_processLogs) (66) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:53,513::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:53,515::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-40::DEBUG::2014-08-12 16:42:53,525::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:42:53,527::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 16:42:53,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:53,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:53,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:53,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:53,532::__init__::225::IOProcess::(_processLogs) (67) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:42:53,533::__init__::225::IOProcess::(_processLogs) (67) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 16:42:53,535::__init__::225::IOProcess::(_processLogs) (67) Queuing response >Thread-40::DEBUG::2014-08-12 16:42:53,536::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:42:53,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:53,539::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:42:53,541::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:42:53,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:53,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:53,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:53,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:53,546::__init__::225::IOProcess::(_processLogs) (68) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:42:53,547::__init__::225::IOProcess::(_processLogs) (68) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:42:53,549::__init__::225::IOProcess::(_processLogs) (68) Queuing response >Thread-40::DEBUG::2014-08-12 16:42:53,549::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=673835d8db3efe8685ee06bbf6bd04fd56d8e345'] >Thread-29::DEBUG::2014-08-12 16:42:53,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:53,553::__init__::225::IOProcess::(_processLogs) Sending response sized 542 >Thread-29::DEBUG::2014-08-12 16:42:53,555::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 16:42:53,556::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:53,557::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:42:53,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:53,559::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:53,561::__init__::225::IOProcess::(_processLogs) (69) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:42:53,562::__init__::225::IOProcess::(_processLogs) (69) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:42:53,564::__init__::225::IOProcess::(_processLogs) (69) Building response >Thread-29::DEBUG::2014-08-12 16:42:53,564::__init__::225::IOProcess::(_processLogs) (69) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:53,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:53,564::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:42:53,564::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-29::DEBUG::2014-08-12 16:42:53,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:53,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:53,565::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:53,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:53,565::__init__::225::IOProcess::(_processLogs) (70) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:42:53,565::__init__::225::IOProcess::(_processLogs) (70) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:42:53,566::__init__::225::IOProcess::(_processLogs) (70) Queuing response >Thread-40::DEBUG::2014-08-12 16:42:53,567::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 16:42:53,567::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-40::INFO::2014-08-12 16:42:53,567::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-40::INFO::2014-08-12 16:42:53,568::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-29::DEBUG::2014-08-12 16:42:53,568::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:42:53,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:53,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:53,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:53,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:53,569::__init__::225::IOProcess::(_processLogs) (71) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:42:53,569::__init__::225::IOProcess::(_processLogs) (71) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:42:53,571::__init__::225::IOProcess::(_processLogs) (71) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:53,571::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-40::DEBUG::2014-08-12 16:42:53,572::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-40::DEBUG::2014-08-12 16:42:53,580::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000547091 s, 643 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:42:53,581::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:42:53,581::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:53,582::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:53,582::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:53,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:53,582::__init__::225::IOProcess::(_processLogs) (72) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:42:53,582::__init__::225::IOProcess::(_processLogs) (72) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:42:53,583::__init__::225::IOProcess::(_processLogs) (72) Queuing response >Thread-29::DEBUG::2014-08-12 16:42:53,584::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:53,584::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-40::DEBUG::2014-08-12 16:42:53,585::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 changed its status to Valid >Thread-40::INFO::2014-08-12 16:42:53,586::clusterlock::183::Storage.SANLock::(acquireHostId) Acquiring host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 (id: 1) >Thread-42::DEBUG::2014-08-12 16:42:53,586::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-42::DEBUG::2014-08-12 16:42:53,587::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-40::DEBUG::2014-08-12 16:42:53,587::clusterlock::201::Storage.SANLock::(acquireHostId) Host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 successfully acquired (id: 1) >Thread-42::DEBUG::2014-08-12 16:42:53,588::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-43::INFO::2014-08-12 16:42:53,589::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >Thread-17::DEBUG::2014-08-12 16:42:53,637::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:42:53,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:42:53,647::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585926 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:53,664::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-16::DEBUG::2014-08-12 16:42:53,665::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 16:42:53,704::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "0adb6530-ef5f-41f0-8655-a7ca83123c87" not found\n Skipping volume group 0adb6530-ef5f-41f0-8655-a7ca83123c87\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 16:42:53,706::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [' DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc|180aea8f-26ba-4e87-8a94-37d5469519bf|wz--n-|42547019776|22011707392|134217728|317|164|MDT_LEASETIMESEC=60,MDT_VERSION=3,MDT_TYPE=ISCSI,MDT_SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf,MDT_PV0=pv:3600601601282300060dddcba33f2e311&44&uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP&44&pestart:0&44&pecount:317&44&mapoffset:0,MDT_LEASERETRIES=3,MDT_IOOPTIMEOUTSEC=10,MDT_LOCKRENEWALINTERVALSEC=5,MDT_LOCKPOLICY=,MDT_ROLE=Regular,MDT_PHYBLKSIZE=512,MDT_LOGBLKSIZE=512,MDT_VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc,MDT_CLASS=Data,MDT_DESCRIPTION=iscsi_1,RHAT_storage_domain,MDT_POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a,MDT__SHA_CKSUM=189d056969591a327adf4c729525fafb366effde|134217728|67100160|15|1|/dev/mapper/3600601601282300060dddcba33f2e311'] [' Volume group "0adb6530-ef5f-41f0-8655-a7ca83123c87" not found', ' Skipping volume group 0adb6530-ef5f-41f0-8655-a7ca83123c87'] >Thread-15::DEBUG::2014-08-12 16:42:53,707::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:42:53,707::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:42:53,707::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:42:53,707::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:42:53,709::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:42:53,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:42:53,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:42:53,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:42:53,709::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:42:53,710::__init__::225::IOProcess::(_processLogs) (73) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:42:53,710::__init__::225::IOProcess::(_processLogs) (73) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:42:53,710::__init__::225::IOProcess::(_processLogs) (73) Queuing response >Thread-15::INFO::2014-08-12 16:42:53,711::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 16:42:53,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:42:53,712::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-15::DEBUG::2014-08-12 16:42:53,713::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::INFO::2014-08-12 16:42:53,714::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:42:53,714::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:42:53,714::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 16:42:53,714::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:42:53,714::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 16:42:53,715::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 16:42:53,715::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 16:42:53,715::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:42:53,715::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:42:53,716::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:42:53,716::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:42:53,716::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:42:53,716::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:42:53,717::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:42:53,717::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:42:53,717::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:42:53,717::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:42:53,717::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:42:53,718::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:42:53,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`e16a8703-eade-4700-8e4f-8e61fd5f5e85`::finished: True >Thread-15::DEBUG::2014-08-12 16:42:53,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`e16a8703-eade-4700-8e4f-8e61fd5f5e85`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:42:53,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:42:53,718::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:42:53,718::task::993::Storage.TaskManager.Task::(_decref) Task=`e16a8703-eade-4700-8e4f-8e61fd5f5e85`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:42:53,860::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:53,860::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:53,860::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:42:53,861::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:53,869::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000500741 s, 4.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:53,869::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000500741 s, 4.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:42:53,869::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:42:53,869::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:42:53,870::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:42:53,870::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:53,870::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:53,870::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:53,871::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:53,871::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:53,871::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:54,055::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:54,056::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:42:54,056::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:42:54,057::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:42:54,057::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:42:54,057::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:42:54,058::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:54,225::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:42:54,225::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:42:54,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597415 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:02,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`a53eb1c3-fff9-47fc-8f74-8dcb1b412373`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:02,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:43:02,279::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597415', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585926', 'lastCheck': '8.6', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000547091', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:43:02,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`a53eb1c3-fff9-47fc-8f74-8dcb1b412373`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597415', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585926', 'lastCheck': '8.6', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000547091', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:43:02,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`a53eb1c3-fff9-47fc-8f74-8dcb1b412373`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:02,280::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:02,280::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:02,280::task::993::Storage.TaskManager.Task::(_decref) Task=`a53eb1c3-fff9-47fc-8f74-8dcb1b412373`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 16:43:03,590::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:43:03,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:03,592::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:43:03,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-40::DEBUG::2014-08-12 16:43:03,597::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:43:03,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:03,607::__init__::225::IOProcess::(_processLogs) (74) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:43:03,609::__init__::225::IOProcess::(_processLogs) (74) Got request for method 'statvfs' >Thread-40::DEBUG::2014-08-12 16:43:03,609::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000375559 s, 937 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:43:03,611::__init__::225::IOProcess::(_processLogs) (74) Building response >Thread-29::DEBUG::2014-08-12 16:43:03,612::__init__::225::IOProcess::(_processLogs) (74) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:03,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:43:03,613::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-29::DEBUG::2014-08-12 16:43:03,615::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:43:03,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:03,616::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:43:03,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:03,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:03,619::__init__::225::IOProcess::(_processLogs) (75) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:43:03,621::__init__::225::IOProcess::(_processLogs) (75) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:43:03,622::__init__::225::IOProcess::(_processLogs) (75) Building response >Thread-29::DEBUG::2014-08-12 16:43:03,622::__init__::225::IOProcess::(_processLogs) (75) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:03,623::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:43:03,623::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:43:03,650::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:03,659::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010886 s, 3.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:04,235::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:04,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072856 s, 5.6 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:43:13,622::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:43:13,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:13,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:13,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:13,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:13,623::__init__::225::IOProcess::(_processLogs) (76) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:43:13,623::__init__::225::IOProcess::(_processLogs) (76) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:43:13,624::__init__::225::IOProcess::(_processLogs) (76) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:13,625::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-40::DEBUG::2014-08-12 16:43:13,626::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-40::DEBUG::2014-08-12 16:43:13,636::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00159751 s, 220 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:43:13,636::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:43:13,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:13,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:13,637::__init__::225::IOProcess::(_processLogs) (77) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:43:13,639::__init__::225::IOProcess::(_processLogs) (77) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:13,639::__init__::225::IOProcess::(_processLogs) Sending response sized 317 >Thread-17::DEBUG::2014-08-12 16:43:13,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:13,673::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552611 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:14,245::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:14,253::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694343 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:17,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`5225d38b-ee5d-4b37-9d49-1e0e3ce229c4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:17,438::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:43:17,438::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694343', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552611', 'lastCheck': '3.8', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00159751', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:43:17,438::task::1191::Storage.TaskManager.Task::(prepare) Task=`5225d38b-ee5d-4b37-9d49-1e0e3ce229c4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694343', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552611', 'lastCheck': '3.8', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00159751', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:43:17,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`5225d38b-ee5d-4b37-9d49-1e0e3ce229c4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:17,438::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:17,439::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:17,439::task::993::Storage.TaskManager.Task::(_decref) Task=`5225d38b-ee5d-4b37-9d49-1e0e3ce229c4`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:43:20,662::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:43:20,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`a295f267-1b4e-4981-ab3e-0e52193ecd54`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:20,663::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'attached'}, options=None) >Thread-15::DEBUG::2014-08-12 16:43:20,664::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5c06d222-c3fc-4a57-8faf-82041a5d68d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:43:20,664::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:43:20,664::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:43:20,664::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5c06d222-c3fc-4a57-8faf-82041a5d68d8`::Granted request >Thread-15::DEBUG::2014-08-12 16:43:20,665::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`be70c5d2-5700-44ef-9c59-a77d09d4f14c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:43:20,665::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:43:20,665::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:43:20,665::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`be70c5d2-5700-44ef-9c59-a77d09d4f14c`::Granted request >Thread-15::DEBUG::2014-08-12 16:43:20,666::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'attached'} >Thread-15::INFO::2014-08-12 16:43:20,666::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'Attached'} >Thread-15::DEBUG::2014-08-12 16:43:20,666::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,666::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,667::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,667::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,667::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,667::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,668::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:43:20,668::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:20,668::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:43:20,668::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:20,668::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:43:20,668::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:20,689::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:43:20,691::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:20,760::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:20,760::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,760::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,761::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,761::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,761::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,761::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,762::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:43:20,762::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:20,764::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:21,032::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:21,032::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:21,033::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:43:21,033::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:21,042::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000569853 s, 3.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:21,042::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000569853 s, 3.6 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:43:21,042::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:43:21,043::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:43:21,043::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:43:21,043::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:21,043::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:21,044::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:21,044::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:21,044::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:21,044::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:21,222::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:21,223::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:21,223::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:43:21,224::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:43:21,224::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:43:21,225::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:43:21,225::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 16:43:21,225::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:43:21,225::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 16:43:21,226::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-40::DEBUG::2014-08-12 16:43:21,226::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:43:21,228::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:43:21,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:21,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:21,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:21,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:21,229::__init__::225::IOProcess::(_processLogs) (78) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:43:21,229::__init__::225::IOProcess::(_processLogs) (78) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:43:21,229::__init__::225::IOProcess::(_processLogs) (78) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:21,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:43:21,232::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-40::DEBUG::2014-08-12 16:43:21,234::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:43:21,235::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 16:43:21,235::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:21,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:21,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:21,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:21,236::__init__::225::IOProcess::(_processLogs) (79) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:43:21,236::__init__::225::IOProcess::(_processLogs) (79) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 16:43:21,236::__init__::225::IOProcess::(_processLogs) (79) Queuing response >Thread-40::DEBUG::2014-08-12 16:43:21,237::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:43:21,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:43:21,239::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:43:21,239::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:43:21,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:21,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:21,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:21,240::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:21,240::__init__::225::IOProcess::(_processLogs) (80) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:43:21,240::__init__::225::IOProcess::(_processLogs) (80) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:43:21,240::__init__::225::IOProcess::(_processLogs) (80) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:21,241::__init__::225::IOProcess::(_processLogs) Sending response sized 542 >Thread-40::DEBUG::2014-08-12 16:43:21,241::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=673835d8db3efe8685ee06bbf6bd04fd56d8e345'] >Thread-29::DEBUG::2014-08-12 16:43:21,243::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 16:43:21,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:21,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:21,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:21,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:21,244::__init__::225::IOProcess::(_processLogs) (81) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:43:21,244::__init__::225::IOProcess::(_processLogs) (81) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:43:21,245::__init__::225::IOProcess::(_processLogs) (81) Building response >Thread-29::DEBUG::2014-08-12 16:43:21,245::__init__::225::IOProcess::(_processLogs) (81) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:21,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:43:21,245::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:43:21,245::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-29::DEBUG::2014-08-12 16:43:21,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:21,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:21,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:21,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:21,246::__init__::225::IOProcess::(_processLogs) (82) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:43:21,246::__init__::225::IOProcess::(_processLogs) (82) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:43:21,247::__init__::225::IOProcess::(_processLogs) (82) Building response >Thread-29::DEBUG::2014-08-12 16:43:21,247::__init__::225::IOProcess::(_processLogs) (82) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:21,247::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-40::DEBUG::2014-08-12 16:43:21,247::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-40::INFO::2014-08-12 16:43:21,248::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-40::INFO::2014-08-12 16:43:21,248::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-40::INFO::2014-08-12 16:43:21,248::clusterlock::206::Storage.SANLock::(releaseHostId) Releasing host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 (id: 1) >Thread-40::DEBUG::2014-08-12 16:43:23,249::clusterlock::216::Storage.SANLock::(releaseHostId) Host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 released successfully (id: 1) >Thread-15::DEBUG::2014-08-12 16:43:23,251::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` stopped monitoring domain `0adb6530-ef5f-41f0-8655-a7ca83123c87` >Thread-15::DEBUG::2014-08-12 16:43:23,252::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:43:23,253::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:43:23,254::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 16:43:23,256::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:23,257::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:23,440::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:23,441::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:23,441::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:43:23,441::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:43:23,441::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:43:23,441::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:43:23,443::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:43:23,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:23,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:43:23,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:23,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:23,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:23,444::__init__::225::IOProcess::(_processLogs) (83) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:43:23,444::__init__::225::IOProcess::(_processLogs) (83) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:43:23,444::__init__::225::IOProcess::(_processLogs) (83) Queuing response >Thread-15::INFO::2014-08-12 16:43:23,446::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 16:43:23,446::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:43:23,447::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-15::DEBUG::2014-08-12 16:43:23,447::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 16:43:23,448::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 16:43:23,448::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:43:23,449::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 16:43:23,449::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 16:43:23,450::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 16:43:23,450::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:43:23,450::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:43:23,450::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:43:23,451::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:43:23,451::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:43:23,451::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:43:23,451::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:43:23,452::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:43:23,452::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:43:23,452::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:43:23,452::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:43:23,452::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:43:23,452::task::1191::Storage.TaskManager.Task::(prepare) Task=`a295f267-1b4e-4981-ab3e-0e52193ecd54`::finished: True >Thread-15::DEBUG::2014-08-12 16:43:23,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`a295f267-1b4e-4981-ab3e-0e52193ecd54`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:23,453::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:23,453::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:23,453::task::993::Storage.TaskManager.Task::(_decref) Task=`a295f267-1b4e-4981-ab3e-0e52193ecd54`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:43:23,465::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4f870aa5] >Thread-15::DEBUG::2014-08-12 16:43:23,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`e41269c3-bb48-4c11-b3de-264530ad9865`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:23,465::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:43:23,466::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:23,525::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:43:23,526::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:23,526::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:43:23,526::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:23,526::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:43:23,527::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:23,555::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:43:23,556::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:23,619::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:23,619::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:23,619::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:23,620::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:23,620::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:23,620::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:23,620::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:23,620::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 16:43:23,621::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:43:23,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`e41269c3-bb48-4c11-b3de-264530ad9865`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:43:23,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`e41269c3-bb48-4c11-b3de-264530ad9865`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:23,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:23,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:23,627::task::993::Storage.TaskManager.Task::(_decref) Task=`e41269c3-bb48-4c11-b3de-264530ad9865`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:43:23,689::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:23,887::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:43:23,888::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:23,897::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609314 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:43:23,898::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:23,898::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:24,076::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:43:24,076::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,255::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,255::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:24,438::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:24,439::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,439::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:43:24,439::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:24,448::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000490129 s, 4.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:24,448::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000490129 s, 4.2 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:43:24,448::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:43:24,449::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:43:24,449::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:43:24,449::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,449::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,450::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,450::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,450::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,450::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:24,634::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:24,635::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:24,635::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:43:24,636::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:43:24,636::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:43:24,637::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:43:24,637::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:24,802::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:24,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:24,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533935 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:32,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`03b451e8-8eae-44b3-afed-4ebb1cab14e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:32,562::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:43:32,562::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533935', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609314', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:43:32,562::task::1191::Storage.TaskManager.Task::(prepare) Task=`03b451e8-8eae-44b3-afed-4ebb1cab14e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533935', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609314', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:43:32,562::task::595::Storage.TaskManager.Task::(_updateState) Task=`03b451e8-8eae-44b3-afed-4ebb1cab14e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:32,562::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:32,563::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:32,563::task::993::Storage.TaskManager.Task::(_decref) Task=`03b451e8-8eae-44b3-afed-4ebb1cab14e5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:43:34,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:34,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664756 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:34,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:34,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781404 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:42,795::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [697a95bf] >Thread-15::DEBUG::2014-08-12 16:43:42,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`852950d6-9473-4a26-a4e3-66addbf988c3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:42,796::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:43:42,798::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 16:43:42,799::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=3,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 16:43:42,847::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-29::DEBUG::2014-08-12 16:43:42,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:42,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:43:42,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:42,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:42,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:42,848::__init__::225::IOProcess::(_processLogs) (84) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:43:42,849::__init__::225::IOProcess::(_processLogs) (84) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:43:42,850::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(84) Building response >Thread-29::DEBUG::2014-08-12 16:43:42,850::__init__::225::IOProcess::(_processLogs) (84) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:42,851::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:43:42,851::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-15::DEBUG::2014-08-12 16:43:42,869::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:43:42,870::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:43:42,870::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:43:42,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:42,870::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:43:42,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:42,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:42,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:42,871::__init__::225::IOProcess::(_processLogs) (85) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:43:42,871::__init__::225::IOProcess::(_processLogs) (85) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:43:42,873::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(85) Building response >Thread-29::DEBUG::2014-08-12 16:43:42,873::__init__::225::IOProcess::(_processLogs) (85) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:42,874::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 16:43:42,874::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-29::DEBUG::2014-08-12 16:43:42,875::__init__::225::IOProcess::(_processLogs) Sending response sized 191 >Thread-15::DEBUG::2014-08-12 16:43:42,876::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 16:43:42,876::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:43:42,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`852950d6-9473-4a26-a4e3-66addbf988c3`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:43:42,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`852950d6-9473-4a26-a4e3-66addbf988c3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:42,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:42,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:42,877::task::993::Storage.TaskManager.Task::(_decref) Task=`852950d6-9473-4a26-a4e3-66addbf988c3`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:43:43,124::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:43:43,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`e74ff353-6587-4d87-9feb-6eda174697d3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:43,125::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 16:43:43,126::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`514a70e3-066e-4f42-bc02-d3b078391449`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:43:43,126::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:43:43,126::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:43:43,126::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`514a70e3-066e-4f42-bc02-d3b078391449`::Granted request >Thread-15::DEBUG::2014-08-12 16:43:43,127::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`80bbf834-f2a2-4051-ae1b-344580cd3308`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:43:43,127::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:43:43,127::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:43:43,127::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`80bbf834-f2a2-4051-ae1b-344580cd3308`::Granted request >Thread-15::DEBUG::2014-08-12 16:43:43,128::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 16:43:43,128::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::DEBUG::2014-08-12 16:43:43,128::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,128::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,128::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,129::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,129::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,129::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,130::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:43:43,130::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:43,130::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:43:43,130::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:43,130::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:43:43,130::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:43,168::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:43:43,169::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:43,242::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:43,243::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,243::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,243::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,243::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,244::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,244::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,244::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:43:43,244::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,247::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:43,466::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:43,467::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,467::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:43:43,468::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:43,476::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000605482 s, 3.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:43,476::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000605482 s, 3.4 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:43:43,476::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:43:43,476::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:43:43,476::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:43:43,477::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,477::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,477::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,477::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,478::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,478::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:43,657::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:43,676::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,676::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:43:43,677::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:43:43,678::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:43:43,678::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:43:43,678::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 16:43:43,678::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:43:43,678::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:43,678::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:43:43,679::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:43:43,680::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 16:43:43,680::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,680::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:43,858::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:43,859::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:43,859::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:43:43,859::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:43:43,859::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:43:43,860::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:43:43,861::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:43:43,861::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:43:43,861::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:43:43,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:43:43,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:43:43,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:43:43,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:43:43,862::__init__::225::IOProcess::(_processLogs) (86) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:43:43,862::__init__::225::IOProcess::(_processLogs) (86) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:43:43,863::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(86) Building response >Thread-15::INFO::2014-08-12 16:43:43,864::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 16:43:43,864::__init__::225::IOProcess::(_processLogs) (86) Queuing response >Thread-29::DEBUG::2014-08-12 16:43:43,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 16:43:43,865::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 16:43:43,866::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-15::DEBUG::2014-08-12 16:43:43,866::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 16:43:43,867::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:43:43,867::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 16:43:43,868::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 16:43:43,868::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 16:43:43,868::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:43:43,868::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:43:43,869::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:43:43,869::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:43:43,869::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:43:43,869::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:43:43,869::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:43:43,870::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:43:43,870::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:43:43,870::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:43:43,870::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:43:43,870::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:43:43,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`e74ff353-6587-4d87-9feb-6eda174697d3`::finished: True >Thread-15::DEBUG::2014-08-12 16:43:43,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`e74ff353-6587-4d87-9feb-6eda174697d3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:43,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:43,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:43,871::task::993::Storage.TaskManager.Task::(_decref) Task=`e74ff353-6587-4d87-9feb-6eda174697d3`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:43:43,891::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [35c66816] >Thread-15::DEBUG::2014-08-12 16:43:43,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`299574cc-198a-4974-b484-db076d4d2662`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:43,892::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:43:43,893::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:43,934::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:43:43,934::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:43,935::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:43:43,935::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:43:43,935::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:43:43,935::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:43,956::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:43:43,958::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:43:44,017::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:44,017::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:44,017::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:44,018::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:44,018::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:44,018::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:44,018::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:43:44,019::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 16:43:44,019::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:43:44,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`299574cc-198a-4974-b484-db076d4d2662`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:43:44,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`299574cc-198a-4974-b484-db076d4d2662`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:44,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:44,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:44,020::task::993::Storage.TaskManager.Task::(_decref) Task=`299574cc-198a-4974-b484-db076d4d2662`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:43:44,100::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:43:44,100::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:44,102::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:44,287::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:43:44,288::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:44,288::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:43:44,289::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:44,297::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000489654 s, 4.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:43:44,297::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000489654 s, 4.2 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:43:44,297::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:43:44,297::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:43:44,297::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:43:44,298::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:44,298::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:44,298::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:44,298::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:44,299::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:44,299::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:44,483::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:43:44,484::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:43:44,484::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:43:44,485::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:43:44,485::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:43:44,486::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:43:44,486::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:44,652::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:43:44,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:44,661::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000550498 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:44,823::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:43:44,823::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:44,824::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:45,006::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:45,007::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:45,007::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:43:45,007::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:45,017::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000508729 s, 4.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:45,017::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000508729 s, 4.0 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:43:45,017::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:43:45,017::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:43:45,018::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:43:45,018::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:45,018::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:45,018::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:45,019::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:45,019::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:45,019::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:45,197::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:45,197::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:43:45,198::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:43:45,199::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:43:45,199::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:43:45,199::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:43:45,199::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:45,365::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:45,366::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:45,374::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000531898 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:43:47,679::task::595::Storage.TaskManager.Task::(_updateState) Task=`14fe0817-e869-4ec2-9493-180bc5d5f274`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:43:47,679::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:43:47,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531898', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550498', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:43:47,679::task::1191::Storage.TaskManager.Task::(prepare) Task=`14fe0817-e869-4ec2-9493-180bc5d5f274`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531898', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550498', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:43:47,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`14fe0817-e869-4ec2-9493-180bc5d5f274`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:43:47,680::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:43:47,680::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:43:47,680::task::993::Storage.TaskManager.Task::(_decref) Task=`14fe0817-e869-4ec2-9493-180bc5d5f274`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:43:54,669::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:43:54,678::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708548 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:43:55,376::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:43:55,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601123 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:44:02,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c4c15ee-c138-41c0-b0ab-440b50b5b760`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:44:02,797::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:44:02,797::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601123', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708548', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:44:02,797::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c4c15ee-c138-41c0-b0ab-440b50b5b760`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601123', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708548', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:44:02,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c4c15ee-c138-41c0-b0ab-440b50b5b760`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:44:02,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:44:02,798::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:44:02,798::task::993::Storage.TaskManager.Task::(_decref) Task=`7c4c15ee-c138-41c0-b0ab-440b50b5b760`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:44:04,682::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:44:04,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737802 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:44:05,385::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:44:05,393::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628705 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:44:14,695::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:44:14,702::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000546504 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:44:15,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:44:15,403::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598992 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:44:17,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`35addcf1-641d-4c2f-82c1-c0417bebe46a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:44:17,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:44:17,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598992', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546504', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:44:17,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`35addcf1-641d-4c2f-82c1-c0417bebe46a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598992', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546504', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:44:17,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`35addcf1-641d-4c2f-82c1-c0417bebe46a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:44:17,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:44:17,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:44:17,908::task::993::Storage.TaskManager.Task::(_decref) Task=`35addcf1-641d-4c2f-82c1-c0417bebe46a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:44:24,706::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:44:24,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632628 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:44:25,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:44:25,412::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578756 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:44:33,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2e07ba6-52ed-4992-8785-b33d2d89585b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:44:33,022::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:44:33,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578756', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632628', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:44:33,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2e07ba6-52ed-4992-8785-b33d2d89585b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578756', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632628', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:44:33,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2e07ba6-52ed-4992-8785-b33d2d89585b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:44:33,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:44:33,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:44:33,023::task::993::Storage.TaskManager.Task::(_decref) Task=`f2e07ba6-52ed-4992-8785-b33d2d89585b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:44:34,718::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:44:34,727::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000789267 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:44:35,414::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:44:35,421::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060533 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:44:44,730::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:44:44,738::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664817 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:44:45,423::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:44:45,431::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657804 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:44:48,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`2eaf30da-b3fd-4359-9f17-6a8d95404490`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:44:48,166::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:44:48,167::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657804', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664817', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:44:48,167::task::1191::Storage.TaskManager.Task::(prepare) Task=`2eaf30da-b3fd-4359-9f17-6a8d95404490`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657804', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664817', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:44:48,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`2eaf30da-b3fd-4359-9f17-6a8d95404490`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:44:48,167::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:44:48,167::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:44:48,167::task::993::Storage.TaskManager.Task::(_decref) Task=`2eaf30da-b3fd-4359-9f17-6a8d95404490`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:44:54,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:44:54,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807377 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:44:55,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:44:55,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568866 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:45:03,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`08b7fa08-30d2-4d9b-9554-855e70de0b87`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:45:03,275::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:45:03,275::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568866', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807377', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:45:03,276::task::1191::Storage.TaskManager.Task::(prepare) Task=`08b7fa08-30d2-4d9b-9554-855e70de0b87`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568866', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807377', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:45:03,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`08b7fa08-30d2-4d9b-9554-855e70de0b87`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:45:03,276::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:45:03,276::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:45:03,276::task::993::Storage.TaskManager.Task::(_decref) Task=`08b7fa08-30d2-4d9b-9554-855e70de0b87`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:45:04,753::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:45:04,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739539 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:45:05,443::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:45:05,450::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649269 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:45:14,765::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:45:14,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000691226 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:45:15,452::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:45:15,460::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074024 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:45:18,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`17ce10b3-1761-4568-82cf-1ee96bf2b11a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:45:18,391::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:45:18,391::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074024', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691226', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:45:18,391::task::1191::Storage.TaskManager.Task::(prepare) Task=`17ce10b3-1761-4568-82cf-1ee96bf2b11a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074024', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691226', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:45:18,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`17ce10b3-1761-4568-82cf-1ee96bf2b11a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:45:18,392::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:45:18,392::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:45:18,392::task::993::Storage.TaskManager.Task::(_decref) Task=`17ce10b3-1761-4568-82cf-1ee96bf2b11a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:45:24,776::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:45:24,785::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000819704 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:45:25,462::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:45:25,471::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057418 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:45:33,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`de16adcc-ee49-4b1d-bda9-14d36da42aa4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:45:33,500::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:45:33,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057418', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819704', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:45:33,501::task::1191::Storage.TaskManager.Task::(prepare) Task=`de16adcc-ee49-4b1d-bda9-14d36da42aa4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057418', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819704', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:45:33,501::task::595::Storage.TaskManager.Task::(_updateState) Task=`de16adcc-ee49-4b1d-bda9-14d36da42aa4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:45:33,501::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:45:33,501::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:45:33,501::task::993::Storage.TaskManager.Task::(_decref) Task=`de16adcc-ee49-4b1d-bda9-14d36da42aa4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:45:34,788::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:45:34,797::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080821 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:45:35,472::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:45:35,480::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007781 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:45:44,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:45:44,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058497 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:45:45,481::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:45:45,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066392 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:45:48,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`dea19d63-0469-439e-9248-942f857d56aa`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:45:48,610::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:45:48,610::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066392', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058497', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:45:48,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`dea19d63-0469-439e-9248-942f857d56aa`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066392', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058497', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:45:48,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`dea19d63-0469-439e-9248-942f857d56aa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:45:48,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:45:48,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:45:48,611::task::993::Storage.TaskManager.Task::(_decref) Task=`dea19d63-0469-439e-9248-942f857d56aa`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:45:54,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:45:54,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742986 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:45:55,492::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:45:55,500::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605746 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:03,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a9b0f9b-4a06-44bb-adbc-48011a72fe24`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:46:03,715::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:46:03,715::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605746', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742986', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:46:03,715::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a9b0f9b-4a06-44bb-adbc-48011a72fe24`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605746', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742986', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:46:03,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a9b0f9b-4a06-44bb-adbc-48011a72fe24`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:46:03,716::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:46:03,716::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:46:03,716::task::993::Storage.TaskManager.Task::(_decref) Task=`7a9b0f9b-4a06-44bb-adbc-48011a72fe24`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:46:04,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:46:04,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741298 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:46:05,502::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:46:05,510::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661617 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:46:14,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:46:14,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552744 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:46:15,512::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:46:15,521::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579558 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:18,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f55cc8e-752c-4ce7-89dc-99c8adddbee9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:46:18,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:46:18,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579558', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552744', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:46:18,834::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f55cc8e-752c-4ce7-89dc-99c8adddbee9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579558', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552744', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:46:18,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f55cc8e-752c-4ce7-89dc-99c8adddbee9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:46:18,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:46:18,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:46:18,835::task::993::Storage.TaskManager.Task::(_decref) Task=`3f55cc8e-752c-4ce7-89dc-99c8adddbee9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:46:24,849::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:46:24,857::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707383 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:46:25,523::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:46:25,531::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070486 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:27,610::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4f116873] >Thread-15::DEBUG::2014-08-12 16:46:27,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a28fdc5-284b-4ef9-b300-0701c49c9d52`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:46:27,610::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:46:27,612::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 16:46:27,614::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 16:46:32,657::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:32,657::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-29::DEBUG::2014-08-12 16:46:32,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:32,658::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:32,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:32,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:32,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:32,659::__init__::225::IOProcess::(_processLogs) (87) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:46:32,659::__init__::225::IOProcess::(_processLogs) (87) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:46:32,659::__init__::225::IOProcess::(_processLogs) (87) Building response >Thread-29::DEBUG::2014-08-12 16:46:32,659::__init__::225::IOProcess::(_processLogs) (87) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:32,659::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:46:32,659::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-15::DEBUG::2014-08-12 16:46:32,671::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:46:32,671::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:32,672::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:46:32,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:32,672::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:32,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:32,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:32,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:32,673::__init__::225::IOProcess::(_processLogs) (88) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:46:32,673::__init__::225::IOProcess::(_processLogs) (88) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:46:32,673::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(88) Building response >Thread-15::DEBUG::2014-08-12 16:46:32,673::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-29::DEBUG::2014-08-12 16:46:32,674::__init__::225::IOProcess::(_processLogs) (88) Queuing response >Thread-15::DEBUG::2014-08-12 16:46:32,675::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 16:46:32,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 16:46:32,676::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-29::DEBUG::2014-08-12 16:46:32,677::__init__::225::IOProcess::(_processLogs) Sending response sized 191 >Thread-15::DEBUG::2014-08-12 16:46:32,677::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a28fdc5-284b-4ef9-b300-0701c49c9d52`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:46:32,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a28fdc5-284b-4ef9-b300-0701c49c9d52`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:46:32,678::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:46:32,678::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:46:32,678::task::993::Storage.TaskManager.Task::(_decref) Task=`6a28fdc5-284b-4ef9-b300-0701c49c9d52`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:46:32,687::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [43a78f71] >Thread-15::DEBUG::2014-08-12 16:46:32,687::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d84462f-f655-4a71-b036-df30e8aadbdd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:46:32,687::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='0adb6530-ef5f-41f0-8655-a7ca83123c87', options=None) >Thread-15::DEBUG::2014-08-12 16:46:32,688::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:46:32,688::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:46:32,688::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:46:32,688::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:46:32,688::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:46:32,688::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:46:32,709::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:46:32,711::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:46:32,790::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:32,791::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:32,792::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:32,792::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:32,792::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:32,792::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:32,792::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:32,793::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-29::DEBUG::2014-08-12 16:46:32,794::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:32,794::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:46:32,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:32,795::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:32,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:32,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:32,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:32,795::__init__::225::IOProcess::(_processLogs) (89) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:46:32,795::__init__::225::IOProcess::(_processLogs) (89) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:46:32,801::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(89) Building response >Thread-29::DEBUG::2014-08-12 16:46:32,802::__init__::225::IOProcess::(_processLogs) (89) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:32,802::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:46:32,802::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 198 >Thread-15::DEBUG::2014-08-12 16:46:32,806::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:46:32,807::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:32,807::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 16:46:32,807::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:32,807::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:32,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:32,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:32,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:32,808::__init__::225::IOProcess::(_processLogs) (90) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:46:32,808::__init__::225::IOProcess::(_processLogs) (90) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 16:46:32,812::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(90) Building response >Thread-29::DEBUG::2014-08-12 16:46:32,812::__init__::225::IOProcess::(_processLogs) (90) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:32,813::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 16:46:32,813::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:46:32,814::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:46:32,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:32,815::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:46:32,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:32,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:32,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:32,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:32,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:32,816::__init__::225::IOProcess::(_processLogs) (91) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:46:32,816::__init__::225::IOProcess::(_processLogs) (91) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:46:32,816::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(91) Building response >Thread-29::DEBUG::2014-08-12 16:46:32,816::__init__::225::IOProcess::(_processLogs) (91) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:32,817::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 16:46:32,817::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=674aee93c8b731bf0e42767249a6c48454b08d0e'] >Thread-29::DEBUG::2014-08-12 16:46:32,818::__init__::225::IOProcess::(_processLogs) Sending response sized 494 >Thread-29::DEBUG::2014-08-12 16:46:32,819::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:32,819::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 16:46:32,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:32,820::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:32,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:32,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:32,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:32,821::__init__::225::IOProcess::(_processLogs) (92) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:46:32,821::__init__::225::IOProcess::(_processLogs) (92) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:46:32,821::__init__::225::IOProcess::(_processLogs) (92) Building response >Thread-29::DEBUG::2014-08-12 16:46:32,821::__init__::225::IOProcess::(_processLogs) (92) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:32,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:46:32,821::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:46:32,822::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:32,822::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-29::DEBUG::2014-08-12 16:46:32,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:32,822::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:32,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:32,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:32,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:32,823::__init__::225::IOProcess::(_processLogs) (93) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:46:32,823::__init__::225::IOProcess::(_processLogs) (93) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:46:32,826::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(93) Building response >Thread-15::DEBUG::2014-08-12 16:46:32,826::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 16:46:32,826::__init__::225::IOProcess::(_processLogs) (93) Queuing response >Thread-15::INFO::2014-08-12 16:46:32,827::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-15::INFO::2014-08-12 16:46:32,827::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-29::DEBUG::2014-08-12 16:46:32,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 16:46:32,828::fileSD::339::Storage.StorageDomain::(validate) sdUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:46:32,828::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-29::DEBUG::2014-08-12 16:46:32,829::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:32,829::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:46:32,829::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:32,829::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:32,829::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:32,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:32,830::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:32,830::__init__::225::IOProcess::(_processLogs) (94) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:46:32,830::__init__::225::IOProcess::(_processLogs) (94) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:46:32,834::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|(94) Building response >Thread-29::DEBUG::2014-08-12 16:46:32,834::__init__::225::IOProcess::(_processLogs) (94) Queuing response >Thread-15::DEBUG::2014-08-12 16:46:32,834::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=674aee93c8b731bf0e42767249a6c48454b08d0e'] >Thread-29::DEBUG::2014-08-12 16:46:32,834::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:46:32,835::__init__::225::IOProcess::(_processLogs) Sending response sized 494 >Thread-15::DEBUG::2014-08-12 16:46:32,836::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87`ReqID=`a86aae09-ce4b-437f-aec7-cada8ec1515c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2806' at 'getStorageDomainInfo' >Thread-15::DEBUG::2014-08-12 16:46:32,836::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:46:32,837::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:46:32,837::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87`ReqID=`a86aae09-ce4b-437f-aec7-cada8ec1515c`::Granted request >Thread-15::DEBUG::2014-08-12 16:46:32,837::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4d84462f-f655-4a71-b036-df30e8aadbdd`::_resourcesAcquired: Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87 (shared) >Thread-15::DEBUG::2014-08-12 16:46:32,837::task::993::Storage.TaskManager.Task::(_decref) Task=`4d84462f-f655-4a71-b036-df30e8aadbdd`::ref 1 aborting False >Thread-15::INFO::2014-08-12 16:46:32,839::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'0adb6530-ef5f-41f0-8655-a7ca83123c87', 'version': '3', 'role': 'Regular', 'remotePath': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'pNFS'}} >Thread-15::DEBUG::2014-08-12 16:46:32,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d84462f-f655-4a71-b036-df30e8aadbdd`::finished: {'info': {'uuid': u'0adb6530-ef5f-41f0-8655-a7ca83123c87', 'version': '3', 'role': 'Regular', 'remotePath': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'pNFS'}} >Thread-15::DEBUG::2014-08-12 16:46:32,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d84462f-f655-4a71-b036-df30e8aadbdd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:46:32,840::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87': < ResourceRef 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 16:46:32,840::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:46:32,840::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' >Thread-15::DEBUG::2014-08-12 16:46:32,840::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' (0 active users) >Thread-15::DEBUG::2014-08-12 16:46:32,841::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:46:32,841::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87', Clearing records. >Thread-15::DEBUG::2014-08-12 16:46:32,841::task::993::Storage.TaskManager.Task::(_decref) Task=`4d84462f-f655-4a71-b036-df30e8aadbdd`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:46:33,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`f983a703-4a2d-44c8-8403-fe79efeba701`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:46:33,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:46:33,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070486', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707383', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:46:33,947::task::1191::Storage.TaskManager.Task::(prepare) Task=`f983a703-4a2d-44c8-8403-fe79efeba701`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070486', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707383', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:46:33,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`f983a703-4a2d-44c8-8403-fe79efeba701`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:46:33,948::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:46:33,948::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:46:33,948::task::993::Storage.TaskManager.Task::(_decref) Task=`f983a703-4a2d-44c8-8403-fe79efeba701`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:46:34,860::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:46:34,885::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:46:35,093::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:46:35,094::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:46:35,094::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:46:35,102::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697351 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:46:35,533::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:46:35,533::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:46:35,722::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:46:35,722::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:46:35,723::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:46:35,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649716 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:46:45,107::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:46:45,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00129269 s, 3.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:46:45,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:46:45,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780188 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:49,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d8f6bf6-11f4-47bb-bea4-e95d7033924d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:46:49,078::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:46:49,078::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780188', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129269', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:46:49,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d8f6bf6-11f4-47bb-bea4-e95d7033924d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780188', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129269', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:46:49,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d8f6bf6-11f4-47bb-bea4-e95d7033924d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:46:49,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:46:49,079::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:46:49,079::task::993::Storage.TaskManager.Task::(_decref) Task=`2d8f6bf6-11f4-47bb-bea4-e95d7033924d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:46:55,120::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:46:55,136::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647861 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:46:55,743::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:46:55,751::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572086 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:58,081::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [1df59e3] >Thread-15::DEBUG::2014-08-12 16:46:58,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7c09307-e796-4672-9235-e49db9ee0357`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:46:58,082::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:46:58,084::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:46:58,084::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:58,085::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-29::DEBUG::2014-08-12 16:46:58,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:58,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:58,085::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:58,085::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:58,085::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:58,086::__init__::225::IOProcess::(_processLogs) (95) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:46:58,086::__init__::225::IOProcess::(_processLogs) (95) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:46:58,086::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|(95) Building response >Thread-29::DEBUG::2014-08-12 16:46:58,086::__init__::225::IOProcess::(_processLogs) (95) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:58,087::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 16:46:58,087::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-15::DEBUG::2014-08-12 16:46:58,088::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 16:46:58,088::__init__::225::IOProcess::(_processLogs) Sending response sized 191 >Thread-15::INFO::2014-08-12 16:46:58,088::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:46:58,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7c09307-e796-4672-9235-e49db9ee0357`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:46:58,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7c09307-e796-4672-9235-e49db9ee0357`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:46:58,089::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:46:58,089::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:46:58,089::task::993::Storage.TaskManager.Task::(_decref) Task=`e7c09307-e796-4672-9235-e49db9ee0357`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:46:58,316::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:46:58,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6ae9f05-b285-4329-bf8b-a00d094ee4ea`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:46:58,316::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 16:46:58,316::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`6482a7e0-4439-4e42-a204-f9e8148e7a90`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:46:58,317::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:46:58,317::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:46:58,317::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`6482a7e0-4439-4e42-a204-f9e8148e7a90`::Granted request >Thread-15::DEBUG::2014-08-12 16:46:58,318::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ef944596-12f2-4d1f-9799-1f901764987d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:46:58,318::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:46:58,318::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:46:58,318::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`ef944596-12f2-4d1f-9799-1f901764987d`::Granted request >Thread-15::DEBUG::2014-08-12 16:46:58,318::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'active'} >Thread-15::INFO::2014-08-12 16:46:58,319::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'Active'} >Thread-15::DEBUG::2014-08-12 16:46:58,319::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,319::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,319::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,319::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,320::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,320::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,320::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:46:58,320::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:46:58,320::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:46:58,321::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:46:58,321::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:46:58,321::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:46:58,363::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:46:58,371::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:46:58,443::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:58,444::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,444::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,444::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,445::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,445::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,445::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,445::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:46:58,446::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,448::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:46:58,668::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:58,669::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,669::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:46:58,670::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:46:58,678::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000548039 s, 3.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:58,678::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000548039 s, 3.7 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:46:58,678::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:46:58,678::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:46:58,679::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:46:58,679::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,679::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,680::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,680::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,680::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,680::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:46:58,858::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:46:58,858::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:58,859::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:46:58,860::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:46:58,860::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:46:58,860::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:46:58,860::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 16:46:58,861::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:46:58,861::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 16:46:58,861::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:46:58,862::sp::1410::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` started monitoring domain `0adb6530-ef5f-41f0-8655-a7ca83123c87` >Thread-49::DEBUG::2014-08-12 16:46:58,862::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:46:58,863::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:46:58,865::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:46:58,866::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 16:46:58,868::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-29::DEBUG::2014-08-12 16:46:58,868::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-15::DEBUG::2014-08-12 16:46:58,869::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf 0adb6530-ef5f-41f0-8655-a7ca83123c87 (cwd None) >Thread-29::DEBUG::2014-08-12 16:46:58,869::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-29::DEBUG::2014-08-12 16:46:58,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:58,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:58,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:58,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:58,879::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:58,879::__init__::225::IOProcess::(_processLogs) (96) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:46:58,879::__init__::225::IOProcess::(_processLogs) (96) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:46:58,880::__init__::225::IOProcess::(_processLogs) (96) Building response >Thread-29::DEBUG::2014-08-12 16:46:58,880::__init__::225::IOProcess::(_processLogs) (96) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:58,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:46:58,880::__init__::225::IOProcess::(_processLogs) Sending response sized 198 >Thread-49::DEBUG::2014-08-12 16:46:58,885::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:46:58,886::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:58,886::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 16:46:58,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:58,886::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:58,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:58,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:58,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:58,887::__init__::225::IOProcess::(_processLogs) (97) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:46:58,887::__init__::225::IOProcess::(_processLogs) (97) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 16:46:58,887::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|(97) Building response >Thread-29::DEBUG::2014-08-12 16:46:58,888::__init__::225::IOProcess::(_processLogs) (97) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:58,888::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Generating json... >Thread-49::DEBUG::2014-08-12 16:46:58,889::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:46:58,889::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:46:58,891::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:58,891::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-29::DEBUG::2014-08-12 16:46:58,891::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:58,892::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:58,892::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:58,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:58,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:58,892::__init__::225::IOProcess::(_processLogs) (98) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:46:58,892::__init__::225::IOProcess::(_processLogs) (98) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 16:46:58,893::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|(98) Building response >Thread-29::DEBUG::2014-08-12 16:46:58,893::__init__::225::IOProcess::(_processLogs) (98) Queuing response >Thread-49::DEBUG::2014-08-12 16:46:58,894::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=673835d8db3efe8685ee06bbf6bd04fd56d8e345'] >Thread-29::DEBUG::2014-08-12 16:46:58,893::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:46:58,895::__init__::225::IOProcess::(_processLogs) Sending response sized 542 >Thread-29::DEBUG::2014-08-12 16:46:58,896::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:58,896::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 16:46:58,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:58,897::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:58,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:58,897::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:58,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:58,898::__init__::225::IOProcess::(_processLogs) (99) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:46:58,898::__init__::225::IOProcess::(_processLogs) (99) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:46:58,898::__init__::225::IOProcess::(_processLogs) (99) Building response >Thread-29::DEBUG::2014-08-12 16:46:58,898::__init__::225::IOProcess::(_processLogs) (99) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:58,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:46:58,899::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-29::DEBUG::2014-08-12 16:46:58,899::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:58,899::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 16:46:58,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:58,900::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Queuing request... >Thread-49::DEBUG::2014-08-12 16:46:58,900::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 16:46:58,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-49::INFO::2014-08-12 16:46:58,901::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-49::INFO::2014-08-12 16:46:58,902::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-29::DEBUG::2014-08-12 16:46:58,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:58,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:58,904::__init__::225::IOProcess::(_processLogs) (100) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:46:58,904::__init__::225::IOProcess::(_processLogs) (100) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:46:58,904::__init__::225::IOProcess::(_processLogs) (100) Building response >Thread-29::DEBUG::2014-08-12 16:46:58,904::__init__::225::IOProcess::(_processLogs) (100) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:58,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:46:58,905::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 16:46:58,905::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:58,905::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:46:58,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:58,905::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:58,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:58,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:58,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:58,906::__init__::225::IOProcess::(_processLogs) (101) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:46:58,906::__init__::225::IOProcess::(_processLogs) (101) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:46:58,907::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|(101) Building response >Thread-49::DEBUG::2014-08-12 16:46:58,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:46:58,908::__init__::225::IOProcess::(_processLogs) (101) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:58,917::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-49::DEBUG::2014-08-12 16:46:58,918::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000410591 s, 857 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:46:58,919::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 16:46:58,920::__init__::225::IOProcess::(_processLogs) (93) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:46:58,920::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:46:58,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:58,920::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:58,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:58,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:46:58,921::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:58,921::__init__::225::IOProcess::(_processLogs) (102) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:46:58,921::__init__::225::IOProcess::(_processLogs) (102) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:46:58,921::__init__::225::IOProcess::(_processLogs) (102) Building response >Thread-29::DEBUG::2014-08-12 16:46:58,921::__init__::225::IOProcess::(_processLogs) (102) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:58,922::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:46:58,923::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 changed its status to Valid >Thread-49::INFO::2014-08-12 16:46:58,925::clusterlock::183::Storage.SANLock::(acquireHostId) Acquiring host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 (id: 1) >Thread-51::DEBUG::2014-08-12 16:46:58,925::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-51::DEBUG::2014-08-12 16:46:58,926::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-49::DEBUG::2014-08-12 16:46:58,927::clusterlock::201::Storage.SANLock::(acquireHostId) Host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 successfully acquired (id: 1) >Thread-51::DEBUG::2014-08-12 16:46:58,928::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-52::INFO::2014-08-12 16:46:58,929::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >Thread-15::DEBUG::2014-08-12 16:46:59,064::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "0adb6530-ef5f-41f0-8655-a7ca83123c87" not found\n Skipping volume group 0adb6530-ef5f-41f0-8655-a7ca83123c87\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 16:46:59,066::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [' DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc|180aea8f-26ba-4e87-8a94-37d5469519bf|wz--n-|42547019776|22011707392|134217728|317|164|MDT_LEASETIMESEC=60,MDT_VERSION=3,MDT_TYPE=ISCSI,MDT_SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf,MDT_PV0=pv:3600601601282300060dddcba33f2e311&44&uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP&44&pestart:0&44&pecount:317&44&mapoffset:0,MDT_LEASERETRIES=3,MDT_IOOPTIMEOUTSEC=10,MDT_LOCKRENEWALINTERVALSEC=5,MDT_LOCKPOLICY=,MDT_ROLE=Regular,MDT_PHYBLKSIZE=512,MDT_LOGBLKSIZE=512,MDT_VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc,MDT_CLASS=Data,MDT_DESCRIPTION=iscsi_1,RHAT_storage_domain,MDT_POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a,MDT__SHA_CKSUM=189d056969591a327adf4c729525fafb366effde|134217728|67100160|15|1|/dev/mapper/3600601601282300060dddcba33f2e311'] [' Volume group "0adb6530-ef5f-41f0-8655-a7ca83123c87" not found', ' Skipping volume group 0adb6530-ef5f-41f0-8655-a7ca83123c87'] >Thread-15::DEBUG::2014-08-12 16:46:59,066::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:46:59,067::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:46:59,067::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:46:59,067::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:46:59,067::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:46:59,068::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 16:46:59,068::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:46:59,069::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:46:59,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:46:59,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:46:59,069::__init__::225::IOProcess::(_processLogs) (103) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:46:59,069::__init__::225::IOProcess::(_processLogs) (103) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:46:59,069::__init__::225::IOProcess::(_processLogs) (103) Building response >Thread-29::DEBUG::2014-08-12 16:46:59,070::__init__::225::IOProcess::(_processLogs) (103) Queuing response >Thread-29::DEBUG::2014-08-12 16:46:59,070::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::INFO::2014-08-12 16:46:59,071::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 16:46:59,072::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::INFO::2014-08-12 16:46:59,072::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:46:59,073::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-15::DEBUG::2014-08-12 16:46:59,073::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 16:46:59,073::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:46:59,073::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 16:46:59,073::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 16:46:59,074::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 16:46:59,074::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:46:59,074::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:46:59,074::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:46:59,075::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:46:59,075::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:46:59,075::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:46:59,075::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:46:59,076::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:46:59,076::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:46:59,076::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:46:59,076::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:46:59,076::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:46:59,076::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6ae9f05-b285-4329-bf8b-a00d094ee4ea`::finished: True >Thread-15::DEBUG::2014-08-12 16:46:59,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6ae9f05-b285-4329-bf8b-a00d094ee4ea`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:46:59,077::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:46:59,077::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:46:59,077::task::993::Storage.TaskManager.Task::(_decref) Task=`f6ae9f05-b285-4329-bf8b-a00d094ee4ea`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:47:04,188::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a048b00-8df8-400a-8c80-c2f38b6367da`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:47:04,188::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:47:04,189::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572086', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647861', 'lastCheck': '9.0', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000410591', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:47:04,189::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a048b00-8df8-400a-8c80-c2f38b6367da`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572086', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647861', 'lastCheck': '9.0', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000410591', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:47:04,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a048b00-8df8-400a-8c80-c2f38b6367da`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:47:04,189::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:47:04,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:47:04,189::task::993::Storage.TaskManager.Task::(_decref) Task=`5a048b00-8df8-400a-8c80-c2f38b6367da`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:47:05,139::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:47:05,308::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:47:05,308::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:47:05,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00052482 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:05,754::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:47:05,755::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:05,764::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000646659 s, 3.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:05,764::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000646659 s, 3.2 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:47:05,764::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:47:05,764::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:47:05,765::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:47:05,765::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:47:05,765::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:47:05,766::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:47:05,766::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:47:05,766::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:47:05,766::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:05,946::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:05,947::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:47:05,947::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:47:05,948::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:47:05,948::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:47:05,948::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:47:05,948::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:06,124::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:06,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:06,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627745 s, 6.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:08,929::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:08,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:08,930::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:08,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:08,930::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:08,931::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:08,931::__init__::225::IOProcess::(_processLogs) (104) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:08,931::__init__::225::IOProcess::(_processLogs) (104) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:08,932::__init__::225::IOProcess::(_processLogs) (104) Queuing response >Thread-49::DEBUG::2014-08-12 16:47:08,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:47:08,933::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:08,941::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:47:08,943::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000490243 s, 718 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:08,944::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:08,944::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:08,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:08,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:08,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:08,945::__init__::225::IOProcess::(_processLogs) (105) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:08,945::__init__::225::IOProcess::(_processLogs) (105) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:08,946::__init__::225::IOProcess::(_processLogs) (105) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:08,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:08,947::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:47:15,321::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:47:15,330::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702537 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:16,134::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:16,142::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638302 s, 6.4 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:18,949::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:18,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:18,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:18,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:18,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:18,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:18,950::__init__::225::IOProcess::(_processLogs) (106) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:18,950::__init__::225::IOProcess::(_processLogs) (106) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:18,951::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(106) Building response >Thread-29::DEBUG::2014-08-12 16:47:18,951::__init__::225::IOProcess::(_processLogs) (106) Queuing response >Thread-49::DEBUG::2014-08-12 16:47:18,952::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:47:18,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:18,961::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:47:18,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000324775 s, 1.1 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:18,962::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:18,963::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:18,963::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:18,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:18,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:18,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:18,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:18,965::__init__::225::IOProcess::(_processLogs) (107) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:18,965::__init__::225::IOProcess::(_processLogs) (107) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:18,965::__init__::225::IOProcess::(_processLogs) (107) Building response >Thread-29::DEBUG::2014-08-12 16:47:18,965::__init__::225::IOProcess::(_processLogs) (107) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:18,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:18,966::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:47:19,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`452a9ceb-b948-4d19-9529-6f7290403151`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:47:19,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:47:19,307::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638302', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702537', 'lastCheck': '4.0', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000324775', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:47:19,307::task::1191::Storage.TaskManager.Task::(prepare) Task=`452a9ceb-b948-4d19-9529-6f7290403151`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638302', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702537', 'lastCheck': '4.0', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000324775', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:47:19,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`452a9ceb-b948-4d19-9529-6f7290403151`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:47:19,307::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:47:19,307::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:47:19,308::task::993::Storage.TaskManager.Task::(_decref) Task=`452a9ceb-b948-4d19-9529-6f7290403151`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:47:25,333::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:47:25,342::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065544 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:26,144::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:26,153::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726586 s, 5.6 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:28,966::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:28,966::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:28,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:28,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:28,967::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:28,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-49::DEBUG::2014-08-12 16:47:28,968::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:47:28,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:28,976::__init__::225::IOProcess::(_processLogs) (108) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:28,976::__init__::225::IOProcess::(_processLogs) (108) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:28,976::__init__::225::IOProcess::(_processLogs) (108) Building response >Thread-29::DEBUG::2014-08-12 16:47:28,976::__init__::225::IOProcess::(_processLogs) (108) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:28,977::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:28,977::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:47:28,977::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000477587 s, 737 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:28,978::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:28,978::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:28,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:28,979::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:28,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:28,980::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:28,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:28,981::__init__::225::IOProcess::(_processLogs) (109) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:28,981::__init__::225::IOProcess::(_processLogs) (109) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:28,981::__init__::225::IOProcess::(_processLogs) (109) Building response >Thread-29::DEBUG::2014-08-12 16:47:28,981::__init__::225::IOProcess::(_processLogs) (109) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:28,981::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:28,982::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:47:34,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1d3dd61-330f-4209-9dda-777293093938`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:47:34,421::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:47:34,422::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726586', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065544', 'lastCheck': '9.1', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477587', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:47:34,422::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1d3dd61-330f-4209-9dda-777293093938`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726586', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065544', 'lastCheck': '9.1', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477587', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:47:34,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1d3dd61-330f-4209-9dda-777293093938`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:47:34,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:47:34,422::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:47:34,423::task::993::Storage.TaskManager.Task::(_decref) Task=`f1d3dd61-330f-4209-9dda-777293093938`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:47:35,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:47:35,354::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705609 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:36,154::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:36,162::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714962 s, 5.7 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:38,981::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:38,982::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:38,990::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:38,991::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:38,992::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-49::DEBUG::2014-08-12 16:47:38,992::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:47:38,992::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:39,000::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:39,001::__init__::225::IOProcess::(_processLogs) (110) Finding callback 'statvfs'... >Thread-49::DEBUG::2014-08-12 16:47:39,002::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000425314 s, 828 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:39,002::__init__::225::IOProcess::(_processLogs) (110) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:39,004::__init__::225::IOProcess::(_processLogs) (110) Building response >Thread-29::DEBUG::2014-08-12 16:47:39,004::__init__::225::IOProcess::(_processLogs) (110) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:39,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:39,004::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 16:47:39,005::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:39,005::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:39,005::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:39,005::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:39,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:39,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:39,006::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:39,006::__init__::225::IOProcess::(_processLogs) (111) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:39,006::__init__::225::IOProcess::(_processLogs) (111) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:39,007::__init__::225::IOProcess::(_processLogs) DEBUG|(111) Building response >Thread-29::DEBUG::2014-08-12 16:47:39,008::__init__::225::IOProcess::(_processLogs) (111) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:39,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:39,008::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:47:45,358::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:47:45,367::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687219 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:46,164::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:46,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000546753 s, 7.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:49,009::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:49,009::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:49,010::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:49,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:49,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:49,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:49,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:49,010::__init__::225::IOProcess::(_processLogs) (112) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:49,011::__init__::225::IOProcess::(_processLogs) (112) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:49,011::__init__::225::IOProcess::(_processLogs) DEBUG|(112) Building response >Thread-49::DEBUG::2014-08-12 16:47:49,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:47:49,012::__init__::225::IOProcess::(_processLogs) (112) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:49,021::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-49::DEBUG::2014-08-12 16:47:49,021::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000538161 s, 654 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:49,037::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 16:47:49,039::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:49,039::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:49,039::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:49,040::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:49,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:49,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:49,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:49,040::__init__::225::IOProcess::(_processLogs) (113) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:49,040::__init__::225::IOProcess::(_processLogs) (113) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:49,041::__init__::225::IOProcess::(_processLogs) DEBUG|(113) Building response >Thread-29::DEBUG::2014-08-12 16:47:49,042::__init__::225::IOProcess::(_processLogs) (113) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:49,042::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:49,043::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:47:49,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebe35f7e-a049-4616-8c8c-e6a799f2b48a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:47:49,534::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:47:49,535::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546753', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687219', 'lastCheck': '4.2', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538161', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:47:49,535::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebe35f7e-a049-4616-8c8c-e6a799f2b48a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546753', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687219', 'lastCheck': '4.2', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538161', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:47:49,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebe35f7e-a049-4616-8c8c-e6a799f2b48a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:47:49,535::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:47:49,535::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:47:49,536::task::993::Storage.TaskManager.Task::(_decref) Task=`ebe35f7e-a049-4616-8c8c-e6a799f2b48a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:47:55,370::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:47:55,379::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647763 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:47:56,173::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:47:56,181::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634391 s, 6.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:59,044::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:59,044::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:59,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:59,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:59,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:59,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:59,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:59,045::__init__::225::IOProcess::(_processLogs) (114) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:59,045::__init__::225::IOProcess::(_processLogs) (114) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:59,046::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(114) Building response >Thread-29::DEBUG::2014-08-12 16:47:59,047::__init__::225::IOProcess::(_processLogs) (114) Queuing response >Thread-49::DEBUG::2014-08-12 16:47:59,047::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:47:59,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:59,055::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:47:59,056::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000385541 s, 913 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:47:59,057::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:47:59,057::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:47:59,057::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:47:59,058::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:47:59,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:47:59,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:47:59,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:47:59,058::__init__::225::IOProcess::(_processLogs) (115) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:47:59,058::__init__::225::IOProcess::(_processLogs) (115) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:47:59,059::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(115) Building response >Thread-29::DEBUG::2014-08-12 16:47:59,060::__init__::225::IOProcess::(_processLogs) (115) Queuing response >Thread-29::DEBUG::2014-08-12 16:47:59,060::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:47:59,061::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:48:04,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`eccf514e-7c29-40c7-a949-4b467ee33638`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:48:04,657::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:48:04,657::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634391', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647763', 'lastCheck': '9.3', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385541', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:48:04,657::task::1191::Storage.TaskManager.Task::(prepare) Task=`eccf514e-7c29-40c7-a949-4b467ee33638`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634391', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647763', 'lastCheck': '9.3', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385541', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:48:04,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`eccf514e-7c29-40c7-a949-4b467ee33638`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:48:04,658::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:48:04,658::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:48:04,658::task::993::Storage.TaskManager.Task::(_decref) Task=`eccf514e-7c29-40c7-a949-4b467ee33638`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:48:05,383::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:05,392::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654878 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:06,183::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:06,191::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548551 s, 7.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:09,062::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:09,062::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:09,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:09,062::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:09,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:09,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:09,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:09,063::__init__::225::IOProcess::(_processLogs) (116) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:09,063::__init__::225::IOProcess::(_processLogs) (116) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:09,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(116) Building response >Thread-29::DEBUG::2014-08-12 16:48:09,065::__init__::225::IOProcess::(_processLogs) (116) Queuing response >Thread-49::DEBUG::2014-08-12 16:48:09,065::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:48:09,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:09,073::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:48:09,074::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000452977 s, 777 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:09,075::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:09,075::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:09,075::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:09,075::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:09,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:09,075::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:09,076::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:09,076::__init__::225::IOProcess::(_processLogs) (117) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:09,076::__init__::225::IOProcess::(_processLogs) (117) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:09,077::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(117) Building response >Thread-29::DEBUG::2014-08-12 16:48:09,077::__init__::225::IOProcess::(_processLogs) (117) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:09,078::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:09,078::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:48:15,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:15,404::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637868 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:16,193::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:16,201::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670231 s, 6.1 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:19,079::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:19,080::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:19,080::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:19,080::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:19,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:19,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:19,081::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:19,082::__init__::225::IOProcess::(_processLogs) (118) Finding callback 'statvfs'... >Thread-49::DEBUG::2014-08-12 16:48:19,083::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:48:19,084::__init__::225::IOProcess::(_processLogs) (118) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:19,092::__init__::225::IOProcess::(_processLogs) (118) Building response >Thread-49::DEBUG::2014-08-12 16:48:19,093::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000473658 s, 743 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:19,094::__init__::225::IOProcess::(_processLogs) (118) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:19,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:19,095::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 16:48:19,096::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:19,096::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:19,096::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:19,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:19,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:19,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:19,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:19,097::__init__::225::IOProcess::(_processLogs) (119) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:19,097::__init__::225::IOProcess::(_processLogs) (119) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:19,097::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(119) Building response >Thread-29::DEBUG::2014-08-12 16:48:19,099::__init__::225::IOProcess::(_processLogs) (119) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:19,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:19,100::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:48:19,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf629020-e9cb-4f21-b68c-1a3f67ac8270`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:48:19,778::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:48:19,778::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670231', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637868', 'lastCheck': '4.4', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473658', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:48:19,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf629020-e9cb-4f21-b68c-1a3f67ac8270`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670231', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637868', 'lastCheck': '4.4', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473658', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:48:19,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf629020-e9cb-4f21-b68c-1a3f67ac8270`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:48:19,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:48:19,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:48:19,779::task::993::Storage.TaskManager.Task::(_decref) Task=`cf629020-e9cb-4f21-b68c-1a3f67ac8270`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:48:25,409::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:25,418::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628079 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:26,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:26,210::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737921 s, 5.6 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:29,100::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:29,101::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:29,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:29,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:29,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:29,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:29,102::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:29,103::__init__::225::IOProcess::(_processLogs) (120) Finding callback 'statvfs'... >Thread-49::DEBUG::2014-08-12 16:48:29,104::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:48:29,105::__init__::225::IOProcess::(_processLogs) (120) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:29,113::__init__::225::IOProcess::(_processLogs) (120) Building response >Thread-49::DEBUG::2014-08-12 16:48:29,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000405531 s, 868 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:29,114::__init__::225::IOProcess::(_processLogs) (120) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:29,115::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:29,115::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 16:48:29,116::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:29,116::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:29,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:29,116::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:29,117::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:29,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:29,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:29,119::__init__::225::IOProcess::(_processLogs) (121) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:29,119::__init__::225::IOProcess::(_processLogs) (121) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:29,119::__init__::225::IOProcess::(_processLogs) (121) Building response >Thread-29::DEBUG::2014-08-12 16:48:29,119::__init__::225::IOProcess::(_processLogs) (121) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:29,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:29,120::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:48:34,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f60b611-aea4-4970-b5ce-6998e1614477`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:48:34,891::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:48:34,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737921', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628079', 'lastCheck': '9.5', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405531', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:48:34,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f60b611-aea4-4970-b5ce-6998e1614477`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737921', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628079', 'lastCheck': '9.5', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405531', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:48:34,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f60b611-aea4-4970-b5ce-6998e1614477`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:48:34,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:48:34,892::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:48:34,892::task::993::Storage.TaskManager.Task::(_decref) Task=`5f60b611-aea4-4970-b5ce-6998e1614477`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:48:35,421::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:35,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000743847 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:36,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:36,221::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00050922 s, 8.0 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:39,120::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:39,120::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:39,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:39,120::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:39,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:39,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:39,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:39,121::__init__::225::IOProcess::(_processLogs) (122) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:39,121::__init__::225::IOProcess::(_processLogs) (122) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:39,122::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(122) Building response >Thread-29::DEBUG::2014-08-12 16:48:39,122::__init__::225::IOProcess::(_processLogs) (122) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:39,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:39,123::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:48:39,124::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-49::DEBUG::2014-08-12 16:48:39,136::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00205735 s, 171 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:39,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:39,137::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:39,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:39,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:39,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:39,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:39,138::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:39,138::__init__::225::IOProcess::(_processLogs) (123) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:39,139::__init__::225::IOProcess::(_processLogs) (123) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:39,139::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(123) Building response >Thread-29::DEBUG::2014-08-12 16:48:39,139::__init__::225::IOProcess::(_processLogs) (123) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:39,140::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:48:39,141::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:48:45,434::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:48:45,434::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:48:45,435::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:45,443::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000598444 s, 3.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:48:45,444::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000598444 s, 3.4 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:48:45,444::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:48:45,444::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:48:45,444::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:48:45,445::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:48:45,445::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:48:45,445::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:48:45,445::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:48:45,445::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:48:45,446::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:45,710::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:48:45,710::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:48:45,711::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:48:45,712::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:48:45,712::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:48:45,712::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:48:45,712::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:45,879::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:48:45,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:45,887::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588045 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:46,222::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:48:46,222::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:48:46,223::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:46,230::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000489516 s, 4.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:46,230::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000489516 s, 4.2 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:48:46,230::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:48:46,230::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:48:46,231::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:48:46,231::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:48:46,231::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:48:46,231::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:48:46,232::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:48:46,232::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:48:46,232::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:46,408::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:46,409::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:48:46,409::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:48:46,410::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:48:46,410::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:48:46,410::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:48:46,411::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:46,577::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:46,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:46,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000559423 s, 7.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:49,143::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:49,143::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:49,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:49,143::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:49,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:49,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:49,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:49,144::__init__::225::IOProcess::(_processLogs) (124) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:49,144::__init__::225::IOProcess::(_processLogs) (124) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:49,144::__init__::225::IOProcess::(_processLogs) (124) Building response >Thread-29::DEBUG::2014-08-12 16:48:49,145::__init__::225::IOProcess::(_processLogs) (124) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:49,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:49,145::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:48:49,146::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-49::DEBUG::2014-08-12 16:48:49,156::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000366134 s, 961 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:49,157::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:49,157::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:49,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:49,158::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:49,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:49,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:49,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:49,160::__init__::225::IOProcess::(_processLogs) (125) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:49,160::__init__::225::IOProcess::(_processLogs) (125) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:49,160::__init__::225::IOProcess::(_processLogs) (125) Building response >Thread-29::DEBUG::2014-08-12 16:48:49,160::__init__::225::IOProcess::(_processLogs) (125) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:49,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:49,161::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:48:49,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b6d6152-a785-4936-950b-4646323c3416`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:48:49,999::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:48:49,999::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559423', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588045', 'lastCheck': '4.1', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366134', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:48:49,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b6d6152-a785-4936-950b-4646323c3416`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559423', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588045', 'lastCheck': '4.1', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366134', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:48:50,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b6d6152-a785-4936-950b-4646323c3416`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:48:50,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:48:50,000::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:48:50,000::task::993::Storage.TaskManager.Task::(_decref) Task=`3b6d6152-a785-4936-950b-4646323c3416`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:48:55,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:48:55,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00157562 s, 2.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:48:56,587::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:48:56,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662783 s, 6.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:59,160::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:59,161::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:59,161::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:59,161::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:59,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:59,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:59,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:59,162::__init__::225::IOProcess::(_processLogs) (126) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:59,162::__init__::225::IOProcess::(_processLogs) (126) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:59,162::__init__::225::IOProcess::(_processLogs) (126) Building response >Thread-29::DEBUG::2014-08-12 16:48:59,162::__init__::225::IOProcess::(_processLogs) (126) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:59,162::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:48:59,163::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:48:59,164::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-49::DEBUG::2014-08-12 16:48:59,176::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00101897 s, 345 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:48:59,177::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:48:59,177::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:48:59,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:48:59,177::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:48:59,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:48:59,178::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:48:59,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:48:59,178::__init__::225::IOProcess::(_processLogs) (127) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:48:59,178::__init__::225::IOProcess::(_processLogs) (127) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:48:59,179::__init__::225::IOProcess::(_processLogs) DEBUG|(127) Building response >Thread-29::DEBUG::2014-08-12 16:48:59,179::__init__::225::IOProcess::(_processLogs) (127) Queuing response >Thread-29::DEBUG::2014-08-12 16:48:59,180::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:48:59,181::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:49:05,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`5851218d-9100-425f-bfb8-81ac45b46ccb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:49:05,120::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:49:05,121::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662783', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157562', 'lastCheck': '9.2', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101897', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:49:05,121::task::1191::Storage.TaskManager.Task::(prepare) Task=`5851218d-9100-425f-bfb8-81ac45b46ccb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662783', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157562', 'lastCheck': '9.2', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101897', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:49:05,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`5851218d-9100-425f-bfb8-81ac45b46ccb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:49:05,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:49:05,121::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:49:05,121::task::993::Storage.TaskManager.Task::(_decref) Task=`5851218d-9100-425f-bfb8-81ac45b46ccb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:49:05,904::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:49:05,912::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645123 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:49:06,596::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:49:06,605::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000852244 s, 4.8 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:09,182::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:49:09,183::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:09,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:09,183::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:49:09,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:09,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:09,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:09,184::__init__::225::IOProcess::(_processLogs) (128) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:09,184::__init__::225::IOProcess::(_processLogs) (128) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:09,185::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(128) Building response >Thread-49::DEBUG::2014-08-12 16:49:09,186::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:49:09,186::__init__::225::IOProcess::(_processLogs) (128) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:09,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:09,194::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:49:09,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000427374 s, 824 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:09,196::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:49:09,196::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:09,196::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:09,196::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:49:09,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:09,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:09,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:09,197::__init__::225::IOProcess::(_processLogs) (129) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:09,197::__init__::225::IOProcess::(_processLogs) (129) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:09,198::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(129) Building response >Thread-29::DEBUG::2014-08-12 16:49:09,199::__init__::225::IOProcess::(_processLogs) (129) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:09,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:09,200::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:49:15,916::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:49:15,925::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00122406 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:49:16,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:49:16,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629829 s, 6.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:19,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:49:19,201::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:19,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:19,202::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:49:19,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-49::DEBUG::2014-08-12 16:49:19,203::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:49:19,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:19,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-49::DEBUG::2014-08-12 16:49:19,214::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000407184 s, 864 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:19,215::__init__::225::IOProcess::(_processLogs) (130) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:19,216::__init__::225::IOProcess::(_processLogs) (130) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:19,216::__init__::225::IOProcess::(_processLogs) (130) Building response >Thread-29::DEBUG::2014-08-12 16:49:19,216::__init__::225::IOProcess::(_processLogs) (130) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:19,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:19,216::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 16:49:19,217::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:49:19,217::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:19,217::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:19,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:49:19,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:19,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:19,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:19,218::__init__::225::IOProcess::(_processLogs) (131) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:19,218::__init__::225::IOProcess::(_processLogs) (131) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:19,219::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(131) Building response >Thread-29::DEBUG::2014-08-12 16:49:19,220::__init__::225::IOProcess::(_processLogs) (131) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:19,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:19,221::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:49:20,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`44fdf352-e00c-4b7a-98f4-c2512c346a09`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:49:20,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:49:20,235::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629829', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122406', 'lastCheck': '4.3', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407184', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:49:20,235::task::1191::Storage.TaskManager.Task::(prepare) Task=`44fdf352-e00c-4b7a-98f4-c2512c346a09`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629829', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122406', 'lastCheck': '4.3', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407184', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:49:20,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`44fdf352-e00c-4b7a-98f4-c2512c346a09`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:49:20,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:49:20,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:49:20,236::task::993::Storage.TaskManager.Task::(_decref) Task=`44fdf352-e00c-4b7a-98f4-c2512c346a09`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:49:25,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:49:25,937::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677437 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:49:26,616::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:49:26,625::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000801333 s, 5.1 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:29,221::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:49:29,222::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:29,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:29,223::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-49::DEBUG::2014-08-12 16:49:29,224::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:49:29,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:29,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:29,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-49::DEBUG::2014-08-12 16:49:29,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000415743 s, 847 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:29,237::__init__::225::IOProcess::(_processLogs) (132) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:29,237::__init__::225::IOProcess::(_processLogs) (132) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:29,237::__init__::225::IOProcess::(_processLogs) (132) Building response >Thread-29::DEBUG::2014-08-12 16:49:29,237::__init__::225::IOProcess::(_processLogs) (132) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:29,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:29,238::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 16:49:29,238::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:49:29,238::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:29,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:29,239::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:49:29,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:29,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:29,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:29,239::__init__::225::IOProcess::(_processLogs) (133) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:29,239::__init__::225::IOProcess::(_processLogs) (133) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:29,240::__init__::225::IOProcess::(_processLogs) (133) Building response >Thread-29::DEBUG::2014-08-12 16:49:29,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:29,242::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:49:35,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`02b80756-572d-44ac-b318-8c675f90c225`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:49:35,350::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:49:35,351::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000801333', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677437', 'lastCheck': '9.4', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415743', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:49:35,351::task::1191::Storage.TaskManager.Task::(prepare) Task=`02b80756-572d-44ac-b318-8c675f90c225`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000801333', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677437', 'lastCheck': '9.4', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415743', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:49:35,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`02b80756-572d-44ac-b318-8c675f90c225`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:49:35,351::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:49:35,351::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:49:35,351::task::993::Storage.TaskManager.Task::(_decref) Task=`02b80756-572d-44ac-b318-8c675f90c225`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:49:35,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:49:35,949::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065768 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:49:36,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:49:36,635::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637632 s, 6.4 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:39,244::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:39,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:39,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:39,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:39,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:39,245::__init__::225::IOProcess::(_processLogs) (134) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:39,245::__init__::225::IOProcess::(_processLogs) (134) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:39,246::__init__::225::IOProcess::(_processLogs) (134) Queuing response >Thread-49::DEBUG::2014-08-12 16:49:39,247::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:49:39,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:39,257::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:49:39,258::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000476523 s, 739 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:39,259::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:39,259::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:39,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:39,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:39,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:39,260::__init__::225::IOProcess::(_processLogs) (135) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:39,260::__init__::225::IOProcess::(_processLogs) (135) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:39,261::__init__::225::IOProcess::(_processLogs) (135) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:39,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:39,262::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:49:45,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:49:45,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662391 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:49:46,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:49:46,645::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650534 s, 6.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:49,263::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:49,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:49,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:49,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:49,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:49,264::__init__::225::IOProcess::(_processLogs) (136) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:49,264::__init__::225::IOProcess::(_processLogs) (136) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:49,265::__init__::225::IOProcess::(_processLogs) (136) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:49,265::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-49::DEBUG::2014-08-12 16:49:49,266::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:49:49,266::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:49:49,275::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000389962 s, 903 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:49,276::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:49,276::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:49:49,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:49,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:49,277::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:49,277::__init__::225::IOProcess::(_processLogs) (137) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:49,277::__init__::225::IOProcess::(_processLogs) (137) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:49,278::__init__::225::IOProcess::(_processLogs) (137) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:49,278::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:49,279::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:49:50,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`edbb3379-6c18-45f8-99dc-749e40ec4bab`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:49:50,491::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:49:50,492::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650534', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662391', 'lastCheck': '4.5', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389962', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:49:50,492::task::1191::Storage.TaskManager.Task::(prepare) Task=`edbb3379-6c18-45f8-99dc-749e40ec4bab`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650534', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662391', 'lastCheck': '4.5', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389962', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:49:50,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`edbb3379-6c18-45f8-99dc-749e40ec4bab`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:49:50,492::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:49:50,492::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:49:50,492::task::993::Storage.TaskManager.Task::(_decref) Task=`edbb3379-6c18-45f8-99dc-749e40ec4bab`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:49:55,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:49:55,985::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667949 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:49:56,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:49:56,658::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632172 s, 6.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:59,280::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:59,280::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:59,281::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:49:59,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:59,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:59,281::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:59,281::__init__::225::IOProcess::(_processLogs) (138) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:59,281::__init__::225::IOProcess::(_processLogs) (138) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:59,282::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(138) Building response >Thread-29::DEBUG::2014-08-12 16:49:59,283::__init__::225::IOProcess::(_processLogs) (138) Queuing response >Thread-49::DEBUG::2014-08-12 16:49:59,283::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:49:59,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:49:59,291::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:49:59,292::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000527309 s, 668 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:49:59,293::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:49:59,293::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:49:59,293::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:49:59,294::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:49:59,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:49:59,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:49:59,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:49:59,294::__init__::225::IOProcess::(_processLogs) (139) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:49:59,294::__init__::225::IOProcess::(_processLogs) (139) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:49:59,295::__init__::225::IOProcess::(_processLogs) (139) Building response >Thread-29::DEBUG::2014-08-12 16:49:59,295::__init__::225::IOProcess::(_processLogs) (139) Queuing response >Thread-29::DEBUG::2014-08-12 16:49:59,295::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:49:59,296::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:50:05,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`296be540-589b-4751-9b95-363d1227e55f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:50:05,618::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:50:05,618::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632172', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667949', 'lastCheck': '9.6', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527309', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:50:05,619::task::1191::Storage.TaskManager.Task::(prepare) Task=`296be540-589b-4751-9b95-363d1227e55f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632172', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667949', 'lastCheck': '9.6', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527309', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:50:05,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`296be540-589b-4751-9b95-363d1227e55f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:50:05,619::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:50:05,619::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:50:05,619::task::993::Storage.TaskManager.Task::(_decref) Task=`296be540-589b-4751-9b95-363d1227e55f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:50:05,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:50:05,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000778311 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:50:06,662::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:50:06,670::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641345 s, 6.4 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:09,298::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:50:09,298::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:09,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:09,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:09,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:09,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:09,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:09,299::__init__::225::IOProcess::(_processLogs) (140) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:09,299::__init__::225::IOProcess::(_processLogs) (140) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:09,300::__init__::225::IOProcess::(_processLogs) DEBUG|(140) Building response >Thread-29::DEBUG::2014-08-12 16:50:09,301::__init__::225::IOProcess::(_processLogs) (140) Queuing response >Thread-49::DEBUG::2014-08-12 16:50:09,301::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:50:09,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:09,312::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:50:09,313::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000376419 s, 935 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:09,313::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:50:09,314::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:09,315::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:09,315::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:09,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:09,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:09,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:09,316::__init__::225::IOProcess::(_processLogs) (141) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:09,317::__init__::225::IOProcess::(_processLogs) (141) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:09,317::__init__::225::IOProcess::(_processLogs) (141) Building response >Thread-29::DEBUG::2014-08-12 16:50:09,317::__init__::225::IOProcess::(_processLogs) (141) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:09,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:09,317::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:50:16,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:50:16,011::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107171 s, 3.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:50:16,672::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:50:16,679::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000775417 s, 5.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:19,317::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:50:19,317::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:19,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:19,336::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:19,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:19,336::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-49::DEBUG::2014-08-12 16:50:19,337::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:50:19,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:19,346::__init__::225::IOProcess::(_processLogs) (142) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:19,346::__init__::225::IOProcess::(_processLogs) (142) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:19,346::__init__::225::IOProcess::(_processLogs) (142) Building response >Thread-29::DEBUG::2014-08-12 16:50:19,346::__init__::225::IOProcess::(_processLogs) (142) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:19,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:19,347::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:50:19,356::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00492945 s, 71.4 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:19,357::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:50:19,357::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:19,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:19,357::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:19,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:19,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:19,358::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:19,358::__init__::225::IOProcess::(_processLogs) (143) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:19,358::__init__::225::IOProcess::(_processLogs) (143) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:19,759::__init__::225::IOProcess::(_processLogs) DEBUG|(143) Building response >Thread-29::DEBUG::2014-08-12 16:50:19,759::__init__::225::IOProcess::(_processLogs) (143) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:19,760::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 16:50:19,761::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:50:20,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4c38fb6-2dea-4873-b6b2-2b94432b8971`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:50:20,722::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:50:20,723::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775417', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107171', 'lastCheck': '4.7', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00492945', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:50:20,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4c38fb6-2dea-4873-b6b2-2b94432b8971`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775417', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107171', 'lastCheck': '4.7', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00492945', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:50:20,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4c38fb6-2dea-4873-b6b2-2b94432b8971`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:50:20,723::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:50:20,723::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:50:20,724::task::993::Storage.TaskManager.Task::(_decref) Task=`b4c38fb6-2dea-4873-b6b2-2b94432b8971`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:50:26,016::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:50:26,025::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676694 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:50:26,681::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:50:26,689::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694937 s, 5.9 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:29,763::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:50:29,763::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:29,763::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:29,763::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:29,764::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:29,764::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:29,764::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:29,764::__init__::225::IOProcess::(_processLogs) (144) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:29,764::__init__::225::IOProcess::(_processLogs) (144) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:29,765::__init__::225::IOProcess::(_processLogs) DEBUG|(144) Building response >Thread-29::DEBUG::2014-08-12 16:50:29,765::__init__::225::IOProcess::(_processLogs) (144) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:29,765::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:29,766::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:50:29,767::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-49::DEBUG::2014-08-12 16:50:29,777::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000408485 s, 862 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:29,777::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:50:29,778::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:29,778::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:29,778::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:29,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:29,778::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:29,779::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:29,779::__init__::225::IOProcess::(_processLogs) (145) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:29,779::__init__::225::IOProcess::(_processLogs) (145) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:29,780::__init__::225::IOProcess::(_processLogs) DEBUG|(145) Building response >Thread-29::DEBUG::2014-08-12 16:50:29,780::__init__::225::IOProcess::(_processLogs) (145) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:29,781::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:29,781::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:50:35,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3214035-ee11-4bbc-aba1-ad4aad1ec789`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:50:35,839::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:50:35,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694937', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676694', 'lastCheck': '9.8', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408485', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:50:35,849::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3214035-ee11-4bbc-aba1-ad4aad1ec789`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694937', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676694', 'lastCheck': '9.8', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408485', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:50:35,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3214035-ee11-4bbc-aba1-ad4aad1ec789`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:50:35,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:50:35,850::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:50:35,850::task::993::Storage.TaskManager.Task::(_decref) Task=`e3214035-ee11-4bbc-aba1-ad4aad1ec789`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:50:36,028::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:50:36,036::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000803796 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:50:36,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:50:36,699::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593164 s, 6.9 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:39,782::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:50:39,782::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:39,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:39,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:39,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:39,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:39,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:39,783::__init__::225::IOProcess::(_processLogs) (146) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:39,784::__init__::225::IOProcess::(_processLogs) (146) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:39,784::__init__::225::IOProcess::(_processLogs) (146) Queuing response >Thread-49::DEBUG::2014-08-12 16:50:39,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:50:39,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:39,793::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:50:39,794::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000599738 s, 587 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:39,795::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:39,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:39,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:39,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:39,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:39,796::__init__::225::IOProcess::(_processLogs) (147) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:39,797::__init__::225::IOProcess::(_processLogs) (147) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:39,798::__init__::225::IOProcess::(_processLogs) (147) Building response >Thread-29::DEBUG::2014-08-12 16:50:39,798::__init__::225::IOProcess::(_processLogs) (147) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:39,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:39,798::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:50:46,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:50:46,065::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707002 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:50:46,701::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:50:46,709::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746364 s, 5.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:49,798::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:49,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:49,799::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:49,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:49,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:49,799::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:49,799::__init__::225::IOProcess::(_processLogs) (148) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:49,799::__init__::225::IOProcess::(_processLogs) (148) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:49,800::__init__::225::IOProcess::(_processLogs) (148) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:49,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-49::DEBUG::2014-08-12 16:50:49,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:50:49,802::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:50:49,812::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000409259 s, 860 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:49,812::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:49,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:49,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:49,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:49,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:49,813::__init__::225::IOProcess::(_processLogs) (149) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:49,813::__init__::225::IOProcess::(_processLogs) (149) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:49,814::__init__::225::IOProcess::(_processLogs) (149) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:49,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:49,816::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:50:50,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`55f60b0b-6655-48f3-8ad2-599c9bc26270`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:50:50,964::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:50:50,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746364', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707002', 'lastCheck': '4.9', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409259', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:50:50,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`55f60b0b-6655-48f3-8ad2-599c9bc26270`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746364', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707002', 'lastCheck': '4.9', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409259', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:50:50,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`55f60b0b-6655-48f3-8ad2-599c9bc26270`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:50:50,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:50:50,965::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:50:50,966::task::993::Storage.TaskManager.Task::(_decref) Task=`55f60b0b-6655-48f3-8ad2-599c9bc26270`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:50:56,069::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:50:56,077::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706167 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:50:56,711::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:50:56,719::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592649 s, 6.9 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:59,817::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:59,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:59,817::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:59,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:59,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:59,818::__init__::225::IOProcess::(_processLogs) (150) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:59,818::__init__::225::IOProcess::(_processLogs) (150) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:59,818::__init__::225::IOProcess::(_processLogs) (150) Queuing response >Thread-49::DEBUG::2014-08-12 16:50:59,819::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:50:59,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:59,827::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:50:59,829::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000847501 s, 415 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:50:59,830::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:50:59,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:50:59,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:50:59,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:50:59,831::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:50:59,831::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 16:50:59,832::__init__::225::IOProcess::(_processLogs) (151) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:50:59,833::__init__::225::IOProcess::(_processLogs) (151) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:50:59,833::__init__::225::IOProcess::(_processLogs) (151) Building response >Thread-29::DEBUG::2014-08-12 16:50:59,834::__init__::225::IOProcess::(_processLogs) (151) Queuing response >Thread-29::DEBUG::2014-08-12 16:50:59,834::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:50:59,834::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:51:06,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6e74f2d-f47f-4c7f-ac11-405d6f12796e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:51:06,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:51:06,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592649', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706167', 'lastCheck': '10.0', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000847501', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:51:06,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6e74f2d-f47f-4c7f-ac11-405d6f12796e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592649', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706167', 'lastCheck': '10.0', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000847501', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:51:06,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6e74f2d-f47f-4c7f-ac11-405d6f12796e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:51:06,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:51:06,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:51:06,078::task::993::Storage.TaskManager.Task::(_decref) Task=`f6e74f2d-f47f-4c7f-ac11-405d6f12796e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:51:06,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:51:06,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592729 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:51:06,721::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:06,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639747 s, 6.4 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:51:09,834::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:09,834::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:51:09,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:09,835::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:09,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:09,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:09,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:09,835::__init__::225::IOProcess::(_processLogs) (152) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:51:09,835::__init__::225::IOProcess::(_processLogs) (152) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:51:09,836::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|(152) Building response >Thread-29::DEBUG::2014-08-12 16:51:09,836::__init__::225::IOProcess::(_processLogs) (152) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:09,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:09,837::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:51:09,838::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-49::DEBUG::2014-08-12 16:51:09,847::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000360805 s, 976 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:51:09,848::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:09,848::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:51:09,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:09,849::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:09,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:09,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:09,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:09,851::__init__::225::IOProcess::(_processLogs) (153) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:51:09,852::__init__::225::IOProcess::(_processLogs) (153) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:51:09,852::__init__::225::IOProcess::(_processLogs) (153) Building response >Thread-29::DEBUG::2014-08-12 16:51:09,852::__init__::225::IOProcess::(_processLogs) (153) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:09,852::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:09,852::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:51:16,107::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:51:16,115::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000542254 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:51:16,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:16,739::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544986 s, 7.5 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:51:19,852::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:19,852::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:51:19,852::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:19,853::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Queuing request... >Thread-49::DEBUG::2014-08-12 16:51:19,854::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:51:19,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:19,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-49::DEBUG::2014-08-12 16:51:19,865::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000359681 s, 979 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:51:19,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:19,867::__init__::225::IOProcess::(_processLogs) (154) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:51:19,867::__init__::225::IOProcess::(_processLogs) (154) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:51:19,867::__init__::225::IOProcess::(_processLogs) (154) Building response >Thread-29::DEBUG::2014-08-12 16:51:19,867::__init__::225::IOProcess::(_processLogs) (154) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:19,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:19,867::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 16:51:19,868::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:19,868::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:51:19,868::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:19,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:19,869::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:19,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:19,870::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:19,871::__init__::225::IOProcess::(_processLogs) (155) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:51:19,871::__init__::225::IOProcess::(_processLogs) (155) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:51:19,871::__init__::225::IOProcess::(_processLogs) (155) Building response >Thread-29::DEBUG::2014-08-12 16:51:19,871::__init__::225::IOProcess::(_processLogs) (155) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:19,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:19,872::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 16:51:21,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`4636baac-d09e-46da-9413-3b1d74b26fea`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:51:21,217::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:51:21,240::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544986', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542254', 'lastCheck': '5.1', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359681', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:51:21,240::task::1191::Storage.TaskManager.Task::(prepare) Task=`4636baac-d09e-46da-9413-3b1d74b26fea`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544986', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542254', 'lastCheck': '5.1', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359681', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:51:21,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`4636baac-d09e-46da-9413-3b1d74b26fea`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:51:21,241::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:51:21,241::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:51:21,241::task::993::Storage.TaskManager.Task::(_decref) Task=`4636baac-d09e-46da-9413-3b1d74b26fea`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:51:26,118::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:51:26,126::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749273 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:51:26,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:26,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646816 s, 6.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:51:29,872::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:29,872::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:51:29,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:29,872::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:29,872::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:29,872::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:29,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:29,873::__init__::225::IOProcess::(_processLogs) (156) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:51:29,873::__init__::225::IOProcess::(_processLogs) (156) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:51:29,874::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(156) Building response >Thread-49::DEBUG::2014-08-12 16:51:29,874::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 16:51:29,875::__init__::225::IOProcess::(_processLogs) (156) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:29,883::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:29,883::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:51:29,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000400892 s, 878 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:51:29,885::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:29,885::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:51:29,885::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:29,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:29,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:29,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:29,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:29,886::__init__::225::IOProcess::(_processLogs) (157) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:51:29,886::__init__::225::IOProcess::(_processLogs) (157) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:51:29,887::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(157) Building response >Thread-29::DEBUG::2014-08-12 16:51:29,888::__init__::225::IOProcess::(_processLogs) (157) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:29,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:29,889::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:51:36,130::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:51:36,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000787221 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:51:36,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eb4c33e-5cac-4aa1-9629-c13d5672f3a7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:51:36,346::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:51:36,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646816', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787221', 'lastCheck': '0.2', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400892', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:51:36,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`3eb4c33e-5cac-4aa1-9629-c13d5672f3a7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646816', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000787221', 'lastCheck': '0.2', 'valid': True}, '0adb6530-ef5f-41f0-8655-a7ca83123c87': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400892', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:51:36,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eb4c33e-5cac-4aa1-9629-c13d5672f3a7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:51:36,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:51:36,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:51:36,347::task::993::Storage.TaskManager.Task::(_decref) Task=`3eb4c33e-5cac-4aa1-9629-c13d5672f3a7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:51:36,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:36,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624624 s, 6.6 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:51:39,889::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:39,890::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:51:39,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:39,890::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:39,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:39,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:39,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:39,891::__init__::225::IOProcess::(_processLogs) (158) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:51:39,891::__init__::225::IOProcess::(_processLogs) (158) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:51:39,891::__init__::225::IOProcess::(_processLogs) (158) Building response >Thread-29::DEBUG::2014-08-12 16:51:39,891::__init__::225::IOProcess::(_processLogs) (158) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:39,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:39,892::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 318 >Thread-49::DEBUG::2014-08-12 16:51:39,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-49::DEBUG::2014-08-12 16:51:39,903::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00126569 s, 278 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 16:51:39,904::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:39,904::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:51:39,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:39,905::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:39,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:39,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:39,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:39,907::__init__::225::IOProcess::(_processLogs) (159) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 16:51:39,907::__init__::225::IOProcess::(_processLogs) (159) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 16:51:39,907::__init__::225::IOProcess::(_processLogs) (159) Building response >Thread-29::DEBUG::2014-08-12 16:51:39,907::__init__::225::IOProcess::(_processLogs) (159) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:39,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:39,908::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 16:51:46,142::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:51:46,151::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635004 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:51:46,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:46,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006478 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:51:47,845::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:51:47,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2750fbf-f6b5-430b-97ea-2c450cae9dd0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:51:47,845::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'attached'}, options=None) >Thread-15::DEBUG::2014-08-12 16:51:47,846::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`f1484143-de34-4414-8565-4d0344ac2391`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:51:47,846::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:51:47,846::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:51:47,847::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`f1484143-de34-4414-8565-4d0344ac2391`::Granted request >Thread-15::DEBUG::2014-08-12 16:51:47,847::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`e2c5c245-65ba-407e-9ee4-60542025bd66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:51:47,847::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:51:47,848::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:51:47,848::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`e2c5c245-65ba-407e-9ee4-60542025bd66`::Granted request >Thread-15::DEBUG::2014-08-12 16:51:47,848::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'attached'} >Thread-15::INFO::2014-08-12 16:51:47,848::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active', '0adb6530-ef5f-41f0-8655-a7ca83123c87': 'Attached'} >Thread-15::DEBUG::2014-08-12 16:51:47,848::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:47,849::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:47,849::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:47,849::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:47,849::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:47,850::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:47,850::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:51:47,850::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:51:47,850::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:51:47,850::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:51:47,850::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:51:47,851::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:47,911::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:51:47,914::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:48,012::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:51:48,013::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,013::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,013::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,013::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,014::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,014::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,014::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:51:48,014::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,017::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:48,228::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:51:48,229::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,229::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:51:48,229::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:48,237::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000476571 s, 4.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:51:48,237::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000476571 s, 4.3 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:51:48,237::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:51:48,237::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:51:48,238::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:51:48,238::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,238::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,238::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,239::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,239::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,239::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:48,424::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:51:48,424::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:48,425::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:51:48,426::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:51:48,426::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:51:48,426::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:51:48,426::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 16:51:48,427::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:51:48,427::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 16:51:48,427::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-49::DEBUG::2014-08-12 16:51:48,427::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:51:48,429::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:48,429::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 16:51:48,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:48,429::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:48,429::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:48,430::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:48,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:48,430::__init__::225::IOProcess::(_processLogs) (160) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:51:48,430::__init__::225::IOProcess::(_processLogs) (160) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:51:48,430::__init__::225::IOProcess::(_processLogs) DEBUG|(160) Building response >Thread-29::DEBUG::2014-08-12 16:51:48,430::__init__::225::IOProcess::(_processLogs) (160) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:48,430::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:48,431::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 199 >Thread-49::DEBUG::2014-08-12 16:51:48,434::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 16:51:48,435::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:48,435::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 16:51:48,435::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:48,435::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:48,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:48,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:48,436::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:48,436::__init__::225::IOProcess::(_processLogs) (161) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 16:51:48,436::__init__::225::IOProcess::(_processLogs) (161) Got request for method 'touch' >Thread-49::DEBUG::2014-08-12 16:51:48,437::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 16:51:48,436::__init__::225::IOProcess::(_processLogs) DEBUG|(161) Building response >Thread-29::DEBUG::2014-08-12 16:51:48,437::__init__::225::IOProcess::(_processLogs) (161) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:48,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:48,438::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 16:51:48,438::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:48,438::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 16:51:48,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:48,439::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:48,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:48,439::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:48,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:48,439::__init__::225::IOProcess::(_processLogs) (162) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 16:51:48,439::__init__::225::IOProcess::(_processLogs) (162) Got request for method 'readfile' >Thread-49::DEBUG::2014-08-12 16:51:48,440::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=673835d8db3efe8685ee06bbf6bd04fd56d8e345'] >Thread-29::DEBUG::2014-08-12 16:51:48,440::__init__::225::IOProcess::(_processLogs) DEBUG|(162) Building response >Thread-29::DEBUG::2014-08-12 16:51:48,441::__init__::225::IOProcess::(_processLogs) (162) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:48,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:48,441::__init__::225::IOProcess::(_processLogs) Sending response sized 543 >Thread-29::DEBUG::2014-08-12 16:51:48,442::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:48,442::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 16:51:48,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:48,442::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:48,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:48,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:48,443::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:48,443::__init__::225::IOProcess::(_processLogs) (163) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:51:48,443::__init__::225::IOProcess::(_processLogs) (163) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:51:48,443::__init__::225::IOProcess::(_processLogs) (163) Building response >Thread-29::DEBUG::2014-08-12 16:51:48,444::__init__::225::IOProcess::(_processLogs) (163) Queuing response >Thread-29::DEBUG::2014-08-12 16:51:48,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:48,444::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 16:51:48,444::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:48,444::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 16:51:48,445::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:48,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:48,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:48,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:48,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:48,445::__init__::225::IOProcess::(_processLogs) (164) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:51:48,446::__init__::225::IOProcess::(_processLogs) (164) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:51:48,446::__init__::225::IOProcess::(_processLogs) DEBUG|(164) Building response >Thread-49::DEBUG::2014-08-12 16:51:48,446::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 16:51:48,447::__init__::225::IOProcess::(_processLogs) (164) Queuing response >Thread-49::INFO::2014-08-12 16:51:48,447::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-29::DEBUG::2014-08-12 16:51:48,447::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-49::INFO::2014-08-12 16:51:48,447::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-29::DEBUG::2014-08-12 16:51:48,448::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-49::INFO::2014-08-12 16:51:48,448::clusterlock::206::Storage.SANLock::(releaseHostId) Releasing host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 (id: 1) >Thread-49::DEBUG::2014-08-12 16:51:50,451::clusterlock::216::Storage.SANLock::(releaseHostId) Host id for domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 released successfully (id: 1) >Thread-15::DEBUG::2014-08-12 16:51:50,451::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` stopped monitoring domain `0adb6530-ef5f-41f0-8655-a7ca83123c87` >Thread-15::DEBUG::2014-08-12 16:51:50,477::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:51:50,477::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:51:50,477::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 16:51:50,478::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:50,478::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:50,663::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:51:50,664::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:50,664::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:51:50,665::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:51:50,665::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:51:50,665::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:51:50,666::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 16:51:50,667::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 16:51:50,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:51:50,667::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:51:50,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:51:50,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:51:50,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:51:50,668::__init__::225::IOProcess::(_processLogs) (165) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:51:50,668::__init__::225::IOProcess::(_processLogs) (165) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 16:51:50,669::__init__::225::IOProcess::(_processLogs) (165) Queuing response >Thread-15::INFO::2014-08-12 16:51:50,670::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 16:51:50,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:51:50,671::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 16:51:50,671::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 16:51:50,672::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 16:51:50,672::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:51:50,672::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 16:51:50,672::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 16:51:50,673::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 16:51:50,673::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:51:50,673::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:51:50,674::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:51:50,674::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:51:50,674::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:51:50,674::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:51:50,675::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:51:50,675::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:51:50,675::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:51:50,675::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:51:50,675::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:51:50,676::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:51:50,676::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2750fbf-f6b5-430b-97ea-2c450cae9dd0`::finished: True >Thread-15::DEBUG::2014-08-12 16:51:50,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2750fbf-f6b5-430b-97ea-2c450cae9dd0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:51:50,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:51:50,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:51:50,676::task::993::Storage.TaskManager.Task::(_decref) Task=`d2750fbf-f6b5-430b-97ea-2c450cae9dd0`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:51:50,688::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [1c67fc02] >Thread-15::DEBUG::2014-08-12 16:51:50,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0378c46-d1af-476d-a9f3-83a8fda4ef50`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:51:50,689::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:51:50,689::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:50,751::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:51:50,751::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:51:50,752::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:51:50,752::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:51:50,752::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:51:50,752::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:50,773::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:51:50,781::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:51:50,840::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:51:50,841::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:50,841::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:50,841::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:50,842::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:50,842::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:50,842::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:51:50,842::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 16:51:50,843::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:51:50,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0378c46-d1af-476d-a9f3-83a8fda4ef50`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:51:50,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0378c46-d1af-476d-a9f3-83a8fda4ef50`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:51:50,843::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:51:50,843::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:51:50,843::task::993::Storage.TaskManager.Task::(_decref) Task=`f0378c46-d1af-476d-a9f3-83a8fda4ef50`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:51:51,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbfb5552-2ef9-4686-be1b-8f7fd8cd2c71`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:51:51,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:51:51,464::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006478', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635004', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:51:51,464::task::1191::Storage.TaskManager.Task::(prepare) Task=`dbfb5552-2ef9-4686-be1b-8f7fd8cd2c71`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006478', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635004', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:51:51,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbfb5552-2ef9-4686-be1b-8f7fd8cd2c71`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:51:51,464::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:51:51,464::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:51:51,464::task::993::Storage.TaskManager.Task::(_decref) Task=`dbfb5552-2ef9-4686-be1b-8f7fd8cd2c71`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:51:56,156::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:51:56,347::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:51:56,348::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:51:56,356::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602818 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:51:56,357::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:51:56,357::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:51:56,541::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:51:56,541::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:56,781::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:56,781::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:56,964::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:51:56,964::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:56,965::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:51:56,965::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:56,973::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000502745 s, 4.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:51:56,973::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000502745 s, 4.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:51:56,974::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:51:56,974::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:51:56,974::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:51:56,974::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:56,974::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:56,975::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:56,975::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:56,975::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:56,975::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:57,152::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:51:57,153::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:51:57,153::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:51:57,154::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:51:57,154::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:51:57,155::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:51:57,155::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:57,321::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:51:57,322::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:51:57,330::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000514413 s, 8.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:52:06,545::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:52:06,554::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072219 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:06,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`52f8a263-2f0b-4de1-a3ee-ce31e78b4cfc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:52:06,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:52:06,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514413', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072219', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:52:06,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`52f8a263-2f0b-4de1-a3ee-ce31e78b4cfc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514413', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072219', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:52:06,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`52f8a263-2f0b-4de1-a3ee-ce31e78b4cfc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:52:06,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:52:06,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:52:06,589::task::993::Storage.TaskManager.Task::(_decref) Task=`52f8a263-2f0b-4de1-a3ee-ce31e78b4cfc`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:52:07,331::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:07,339::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799171 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:09,568::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [7020d004] >Thread-15::DEBUG::2014-08-12 16:52:09,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`1aae6c0f-83cb-4de6-b7f6-7fa4e4c6a601`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:52:09,569::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:52:09,571::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 16:52:09,572::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 16:52:14,615::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 16:52:14,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:52:14,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:52:14,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:52:14,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:52:14,617::__init__::225::IOProcess::(_processLogs) (166) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 16:52:14,618::__init__::225::IOProcess::(_processLogs) (166) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 16:52:14,618::__init__::225::IOProcess::(_processLogs) (166) Building response >Thread-29::DEBUG::2014-08-12 16:52:14,618::__init__::225::IOProcess::(_processLogs) (166) Queuing response >Thread-29::DEBUG::2014-08-12 16:52:14,618::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:52:14,618::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 16:52:14,625::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 16:52:14,625::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 16:52:14,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:52:14,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 16:52:14,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 16:52:14,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 16:52:14,626::__init__::225::IOProcess::(_processLogs) (167) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 16:52:14,626::__init__::225::IOProcess::(_processLogs) (167) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 16:52:14,627::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-29::DEBUG::2014-08-12 16:52:14,627::__init__::225::IOProcess::(_processLogs) (167) Queuing response >Thread-29::DEBUG::2014-08-12 16:52:14,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 16:52:14,629::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 16:52:14,628::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 16:52:14,629::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:52:14,629::task::1191::Storage.TaskManager.Task::(prepare) Task=`1aae6c0f-83cb-4de6-b7f6-7fa4e4c6a601`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:52:14,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`1aae6c0f-83cb-4de6-b7f6-7fa4e4c6a601`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:52:14,630::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:52:14,630::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:52:14,630::task::993::Storage.TaskManager.Task::(_decref) Task=`1aae6c0f-83cb-4de6-b7f6-7fa4e4c6a601`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:52:14,879::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 16:52:14,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b37e66f-4f31-4f3b-9021-6fda39b860ac`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:52:14,880::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 16:52:14,881::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`436e07b8-420f-42fa-a3f5-d5de653083e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:52:14,881::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 16:52:14,881::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 16:52:14,881::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`436e07b8-420f-42fa-a3f5-d5de653083e6`::Granted request >Thread-15::DEBUG::2014-08-12 16:52:14,882::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`82effc7f-4d6a-4e82-9423-e73f665164b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 16:52:14,882::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 16:52:14,882::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 16:52:14,882::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`82effc7f-4d6a-4e82-9423-e73f665164b0`::Granted request >Thread-15::DEBUG::2014-08-12 16:52:14,883::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 16:52:14,883::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::DEBUG::2014-08-12 16:52:14,883::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:14,883::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:14,883::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:14,884::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:14,884::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:14,884::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:14,884::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:52:14,885::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:52:14,885::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:52:14,885::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:52:14,885::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:52:14,885::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:14,929::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:52:14,931::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:14,999::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:14,999::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:14,999::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,000::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,000::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,000::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,000::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,000::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:52:15,001::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,004::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:15,212::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:15,212::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,213::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:52:15,213::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:15,221::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000515264 s, 4.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:15,222::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000515264 s, 4.0 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 16:52:15,222::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 16:52:15,222::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 16:52:15,222::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 16:52:15,223::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,223::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,223::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,223::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,223::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,224::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:15,401::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:15,401::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,401::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 16:52:15,402::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 16:52:15,403::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 16:52:15,403::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 16:52:15,403::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 16:52:15,403::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 16:52:15,403::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:52:15,404::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:52:15,404::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 16:52:15,404::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 16:52:15,404::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,404::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:15,588::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:15,589::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,589::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 16:52:15,589::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 16:52:15,590::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 16:52:15,590::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 16:52:15,591::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 16:52:15,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 16:52:15,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 16:52:15,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-15::INFO::2014-08-12 16:52:15,599::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 16:52:15,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-15::DEBUG::2014-08-12 16:52:15,600::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 16:52:15,600::__init__::225::IOProcess::(_processLogs) (168) Finding callback 'glob'... >Thread-15::DEBUG::2014-08-12 16:52:15,601::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-29::DEBUG::2014-08-12 16:52:15,602::__init__::225::IOProcess::(_processLogs) (168) Got request for method 'glob' >Thread-15::WARNING::2014-08-12 16:52:15,602::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 16:52:15,604::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-29::DEBUG::2014-08-12 16:52:15,604::__init__::225::IOProcess::(_processLogs) (168) Building response >Thread-15::WARNING::2014-08-12 16:52:15,604::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-29::DEBUG::2014-08-12 16:52:15,605::__init__::225::IOProcess::(_processLogs) (168) Queuing response >Thread-29::DEBUG::2014-08-12 16:52:15,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 16:52:15,607::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-29::DEBUG::2014-08-12 16:52:15,607::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 16:52:15,608::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 16:52:15,608::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:52:15,609::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 16:52:15,609::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 16:52:15,609::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 16:52:15,609::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:52:15,609::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 16:52:15,610::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 16:52:15,610::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 16:52:15,610::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 16:52:15,610::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 16:52:15,610::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 16:52:15,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b37e66f-4f31-4f3b-9021-6fda39b860ac`::finished: True >Thread-15::DEBUG::2014-08-12 16:52:15,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b37e66f-4f31-4f3b-9021-6fda39b860ac`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:52:15,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:52:15,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:52:15,611::task::993::Storage.TaskManager.Task::(_decref) Task=`4b37e66f-4f31-4f3b-9021-6fda39b860ac`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 16:52:15,624::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4d6c19d3] >Thread-15::DEBUG::2014-08-12 16:52:15,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`aafa0fc6-b2c5-43f1-8ac0-e461a43032ca`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:52:15,624::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 16:52:15,625::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:15,658::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 16:52:15,659::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:52:15,659::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 16:52:15,659::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 16:52:15,659::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 16:52:15,660::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:15,684::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 16:52:15,686::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 16:52:15,747::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:15,747::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,748::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,748::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,748::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,748::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,749::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 16:52:15,749::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 16:52:15,749::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:52:15,749::task::1191::Storage.TaskManager.Task::(prepare) Task=`aafa0fc6-b2c5-43f1-8ac0-e461a43032ca`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 16:52:15,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`aafa0fc6-b2c5-43f1-8ac0-e461a43032ca`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:52:15,750::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:52:15,750::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:52:15,750::task::993::Storage.TaskManager.Task::(_decref) Task=`aafa0fc6-b2c5-43f1-8ac0-e461a43032ca`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:52:16,567::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:52:16,748::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:52:16,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:52:16,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000512497 s, 8.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:52:16,757::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:52:16,758::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:52:16,936::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:52:16,936::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,341::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,341::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:17,521::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:52:17,522::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,522::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:52:17,523::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:17,531::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000520426 s, 3.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:52:17,531::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000520426 s, 3.9 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:52:17,532::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:52:17,532::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:52:17,532::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:52:17,532::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,532::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,533::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,533::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,533::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,533::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:17,712::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:52:17,713::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:52:17,713::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:52:17,714::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:52:17,714::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:52:17,714::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:52:17,715::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:17,880::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:52:17,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:17,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637798 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:21,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`87739878-eaf3-4479-8750-28a881f25ea2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:52:21,697::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:52:21,697::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637798', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512497', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:52:21,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`87739878-eaf3-4479-8750-28a881f25ea2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637798', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512497', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:52:21,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`87739878-eaf3-4479-8750-28a881f25ea2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:52:21,698::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:52:21,698::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:52:21,698::task::993::Storage.TaskManager.Task::(_decref) Task=`87739878-eaf3-4479-8750-28a881f25ea2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:52:26,943::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:52:26,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730843 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:52:27,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:27,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721664 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:36,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc08c5b0-c867-40e8-9bb8-0b714d5d61e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:52:36,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:52:36,869::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721664', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730843', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:52:36,870::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc08c5b0-c867-40e8-9bb8-0b714d5d61e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721664', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730843', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:52:36,870::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc08c5b0-c867-40e8-9bb8-0b714d5d61e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:52:36,870::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:52:36,870::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:52:36,870::task::993::Storage.TaskManager.Task::(_decref) Task=`fc08c5b0-c867-40e8-9bb8-0b714d5d61e5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:52:36,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:52:36,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630936 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:52:37,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:37,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666915 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:52:46,968::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:52:46,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074046 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:52:47,912::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:47,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000977355 s, 4.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:52:51,992::task::595::Storage.TaskManager.Task::(_updateState) Task=`26936d48-8e76-4a79-ae1c-2f69b1344e3e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:52:51,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:52:52,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000977355', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074046', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:52:52,016::task::1191::Storage.TaskManager.Task::(prepare) Task=`26936d48-8e76-4a79-ae1c-2f69b1344e3e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000977355', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074046', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:52:52,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`26936d48-8e76-4a79-ae1c-2f69b1344e3e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:52:52,017::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:52:52,017::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:52:52,017::task::993::Storage.TaskManager.Task::(_decref) Task=`26936d48-8e76-4a79-ae1c-2f69b1344e3e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:52:57,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:52:57,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592387 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:52:57,921::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:52:57,930::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072344 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:53:07,025::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:07,033::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676198 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:53:07,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`3262c186-b037-4d46-ac81-d65f2317e03c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:53:07,127::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:53:07,127::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072344', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676198', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:53:07,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`3262c186-b037-4d46-ac81-d65f2317e03c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072344', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676198', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:53:07,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`3262c186-b037-4d46-ac81-d65f2317e03c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:53:07,128::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:53:07,128::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:53:07,128::task::993::Storage.TaskManager.Task::(_decref) Task=`3262c186-b037-4d46-ac81-d65f2317e03c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:53:07,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:07,939::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701051 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:53:17,036::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:17,045::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627978 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:53:17,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:17,949::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636387 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:53:22,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`8111d0bb-d3a9-48e0-930f-98d940cd2b44`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:53:22,273::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:53:22,273::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636387', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627978', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:53:22,273::task::1191::Storage.TaskManager.Task::(prepare) Task=`8111d0bb-d3a9-48e0-930f-98d940cd2b44`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636387', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627978', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:53:22,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`8111d0bb-d3a9-48e0-930f-98d940cd2b44`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:53:22,273::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:53:22,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:53:22,274::task::993::Storage.TaskManager.Task::(_decref) Task=`8111d0bb-d3a9-48e0-930f-98d940cd2b44`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:53:27,048::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:27,056::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635576 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:53:27,951::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:27,960::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693962 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:53:37,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:37,084::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732398 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:53:37,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fdcff3b-12a7-473d-a7f4-4cc8e4ba891e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:53:37,387::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:53:37,387::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693962', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732398', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:53:37,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fdcff3b-12a7-473d-a7f4-4cc8e4ba891e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693962', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732398', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:53:37,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fdcff3b-12a7-473d-a7f4-4cc8e4ba891e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:53:37,388::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:53:37,388::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:53:37,388::task::993::Storage.TaskManager.Task::(_decref) Task=`7fdcff3b-12a7-473d-a7f4-4cc8e4ba891e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:53:37,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:37,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056107 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:53:47,088::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:53:47,088::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:53:47,088::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:47,098::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00061556 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:53:47,098::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00061556 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:53:47,098::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:53:47,098::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:53:47,099::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:53:47,099::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:53:47,099::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:53:47,099::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:53:47,100::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:53:47,100::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:53:47,100::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:47,412::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:53:47,412::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:53:47,413::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:53:47,414::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:53:47,414::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:53:47,414::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:53:47,414::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:47,582::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:53:47,583::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:47,591::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0005862 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:53:47,971::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:53:47,971::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:53:47,971::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:47,980::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000698005 s, 2.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:53:47,980::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000698005 s, 2.9 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:53:47,980::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:53:47,980::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:53:47,981::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:53:47,981::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:53:47,981::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:53:47,981::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:53:47,982::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:53:47,982::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:53:47,982::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:48,163::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:53:48,163::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:53:48,164::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:53:48,165::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:53:48,165::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:53:48,165::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:53:48,165::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:48,334::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:53:48,335::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:48,343::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636636 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:53:52,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fe136ed-c0ac-4fab-ae61-f14e5d8c76da`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:53:52,497::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:53:52,498::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636636', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005862', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:53:52,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fe136ed-c0ac-4fab-ae61-f14e5d8c76da`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636636', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005862', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:53:52,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fe136ed-c0ac-4fab-ae61-f14e5d8c76da`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:53:52,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:53:52,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:53:52,501::task::993::Storage.TaskManager.Task::(_decref) Task=`1fe136ed-c0ac-4fab-ae61-f14e5d8c76da`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:53:57,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:53:57,602::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552024 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:53:58,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:53:58,354::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692894 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:54:07,605::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:54:07,614::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742786 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:54:07,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd315ef8-3160-4032-b37e-62e72b5e3589`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:54:07,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:54:07,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692894', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742786', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:54:07,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd315ef8-3160-4032-b37e-62e72b5e3589`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692894', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742786', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:54:07,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd315ef8-3160-4032-b37e-62e72b5e3589`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:54:07,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:54:07,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:54:07,623::task::993::Storage.TaskManager.Task::(_decref) Task=`cd315ef8-3160-4032-b37e-62e72b5e3589`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:54:08,355::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:54:08,363::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578154 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:54:17,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:54:17,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675221 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:54:18,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:54:18,372::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603218 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:54:22,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`35414d63-271e-49fb-b612-e3b7703d5f4f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:54:22,783::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:54:22,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603218', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675221', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:54:22,785::task::1191::Storage.TaskManager.Task::(prepare) Task=`35414d63-271e-49fb-b612-e3b7703d5f4f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603218', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675221', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:54:22,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`35414d63-271e-49fb-b612-e3b7703d5f4f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:54:22,786::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:54:22,787::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:54:22,787::task::993::Storage.TaskManager.Task::(_decref) Task=`35414d63-271e-49fb-b612-e3b7703d5f4f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:54:27,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:54:27,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729394 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:54:28,374::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:54:28,382::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675573 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:54:37,641::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:54:37,649::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706826 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:54:37,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`023f6512-f023-4d55-990d-eb62ee48510f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:54:37,948::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:54:37,948::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675573', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706826', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:54:37,948::task::1191::Storage.TaskManager.Task::(prepare) Task=`023f6512-f023-4d55-990d-eb62ee48510f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675573', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706826', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:54:37,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`023f6512-f023-4d55-990d-eb62ee48510f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:54:37,948::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:54:37,949::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:54:37,949::task::993::Storage.TaskManager.Task::(_decref) Task=`023f6512-f023-4d55-990d-eb62ee48510f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:54:38,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:54:38,392::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000549841 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:54:47,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:54:47,661::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771431 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:54:48,393::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:54:48,401::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061666 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:54:53,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d942215-c92d-46ff-b7cb-84b411df36f6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:54:53,083::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:54:53,084::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061666', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771431', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:54:53,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d942215-c92d-46ff-b7cb-84b411df36f6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061666', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771431', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:54:53,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d942215-c92d-46ff-b7cb-84b411df36f6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:54:53,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:54:53,087::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:54:53,087::task::993::Storage.TaskManager.Task::(_decref) Task=`6d942215-c92d-46ff-b7cb-84b411df36f6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:54:57,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:54:57,672::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00055298 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:54:58,403::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:54:58,412::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000511471 s, 8.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:55:07,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:55:07,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709191 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:55:08,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`019b8e63-1580-4ba6-833c-f49081116458`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:55:08,280::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:55:08,281::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511471', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709191', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:55:08,281::task::1191::Storage.TaskManager.Task::(prepare) Task=`019b8e63-1580-4ba6-833c-f49081116458`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511471', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709191', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:55:08,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`019b8e63-1580-4ba6-833c-f49081116458`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:55:08,282::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:55:08,282::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:55:08,283::task::993::Storage.TaskManager.Task::(_decref) Task=`019b8e63-1580-4ba6-833c-f49081116458`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 16:55:08,413::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:55:08,422::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615024 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:55:17,688::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:55:17,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613527 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:55:18,423::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:55:18,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619766 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:55:23,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`633f0e31-0809-4da6-a59f-8a9b508430fc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:55:23,406::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:55:23,407::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619766', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613527', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:55:23,407::task::1191::Storage.TaskManager.Task::(prepare) Task=`633f0e31-0809-4da6-a59f-8a9b508430fc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619766', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613527', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:55:23,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`633f0e31-0809-4da6-a59f-8a9b508430fc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:55:23,407::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:55:23,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:55:23,407::task::993::Storage.TaskManager.Task::(_decref) Task=`633f0e31-0809-4da6-a59f-8a9b508430fc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:55:27,699::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:55:27,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674188 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:55:28,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:55:28,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578276 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:55:37,712::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:55:37,721::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000867867 s, 4.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:55:38,442::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:55:38,451::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000522529 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:55:38,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`4727fd21-de4e-434e-9e22-b851c0813da8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:55:38,534::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:55:38,534::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522529', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867867', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:55:38,534::task::1191::Storage.TaskManager.Task::(prepare) Task=`4727fd21-de4e-434e-9e22-b851c0813da8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522529', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867867', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:55:38,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`4727fd21-de4e-434e-9e22-b851c0813da8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:55:38,534::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:55:38,535::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:55:38,535::task::993::Storage.TaskManager.Task::(_decref) Task=`4727fd21-de4e-434e-9e22-b851c0813da8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:55:47,724::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:55:47,733::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000811761 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:55:48,452::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:55:48,461::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567257 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:55:53,653::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbe87ce4-8a95-4024-b2a1-87c73556d9d0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:55:53,653::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:55:53,654::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567257', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811761', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:55:53,654::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbe87ce4-8a95-4024-b2a1-87c73556d9d0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567257', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811761', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:55:53,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbe87ce4-8a95-4024-b2a1-87c73556d9d0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:55:53,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:55:53,654::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:55:53,654::task::993::Storage.TaskManager.Task::(_decref) Task=`bbe87ce4-8a95-4024-b2a1-87c73556d9d0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:55:57,736::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:55:57,744::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576195 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:55:58,462::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:55:58,471::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780134 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:56:07,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:56:07,766::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066767 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:56:08,472::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:56:08,481::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706608 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:56:08,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`80e47e3f-9d72-441d-a4a8-29e59cbed740`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:56:08,761::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:56:08,761::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706608', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066767', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:56:08,762::task::1191::Storage.TaskManager.Task::(prepare) Task=`80e47e3f-9d72-441d-a4a8-29e59cbed740`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706608', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066767', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:56:08,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`80e47e3f-9d72-441d-a4a8-29e59cbed740`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:56:08,762::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:56:08,762::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:56:08,762::task::993::Storage.TaskManager.Task::(_decref) Task=`80e47e3f-9d72-441d-a4a8-29e59cbed740`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:56:17,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:56:17,778::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558293 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:56:18,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:56:18,491::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000555517 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:56:23,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`774059d6-b59a-4e2b-bc65-aba6a8868d3d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:56:23,887::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:56:23,888::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555517', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558293', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:56:23,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`774059d6-b59a-4e2b-bc65-aba6a8868d3d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555517', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558293', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:56:23,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`774059d6-b59a-4e2b-bc65-aba6a8868d3d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:56:23,888::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:56:23,888::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:56:23,889::task::993::Storage.TaskManager.Task::(_decref) Task=`774059d6-b59a-4e2b-bc65-aba6a8868d3d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:56:27,781::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:56:27,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617565 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:56:28,493::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:56:28,501::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:56:37,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:56:37,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627597 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:56:38,503::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:56:38,511::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597777 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:56:38,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fc8b86e-5779-4d9c-8141-51e2ad7c9af3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:56:38,998::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:56:38,998::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597777', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627597', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:56:38,998::task::1191::Storage.TaskManager.Task::(prepare) Task=`4fc8b86e-5779-4d9c-8141-51e2ad7c9af3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597777', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627597', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:56:38,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fc8b86e-5779-4d9c-8141-51e2ad7c9af3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:56:38,999::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:56:38,999::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:56:38,999::task::993::Storage.TaskManager.Task::(_decref) Task=`4fc8b86e-5779-4d9c-8141-51e2ad7c9af3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:56:47,804::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:56:47,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639673 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:56:48,512::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:56:48,521::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666479 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:56:54,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4ae4a8f-1457-44e0-b640-43d98eab92e0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:56:54,128::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:56:54,129::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666479', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639673', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:56:54,129::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4ae4a8f-1457-44e0-b640-43d98eab92e0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666479', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639673', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:56:54,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4ae4a8f-1457-44e0-b640-43d98eab92e0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:56:54,129::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:56:54,129::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:56:54,129::task::993::Storage.TaskManager.Task::(_decref) Task=`b4ae4a8f-1457-44e0-b640-43d98eab92e0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:56:57,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:56:57,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637913 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:56:58,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:56:58,530::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642549 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:57:07,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:57:07,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681339 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:57:08,532::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:57:08,542::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636865 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:57:09,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`0804b065-91ce-4cb2-bdbf-decd45059545`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:57:09,241::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:57:09,241::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636865', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681339', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:57:09,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`0804b065-91ce-4cb2-bdbf-decd45059545`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636865', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681339', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:57:09,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`0804b065-91ce-4cb2-bdbf-decd45059545`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:57:09,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:57:09,242::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:57:09,242::task::993::Storage.TaskManager.Task::(_decref) Task=`0804b065-91ce-4cb2-bdbf-decd45059545`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:57:17,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:57:17,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574097 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:57:18,547::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:57:18,555::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609881 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:57:24,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`91cf30a9-6cc5-4b2c-bfad-f2570aec564d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:57:24,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:57:24,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609881', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574097', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:57:24,354::task::1191::Storage.TaskManager.Task::(prepare) Task=`91cf30a9-6cc5-4b2c-bfad-f2570aec564d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609881', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574097', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:57:24,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`91cf30a9-6cc5-4b2c-bfad-f2570aec564d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:57:24,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:57:24,355::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:57:24,355::task::993::Storage.TaskManager.Task::(_decref) Task=`91cf30a9-6cc5-4b2c-bfad-f2570aec564d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:57:27,860::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:57:27,868::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574191 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:57:28,557::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:57:28,565::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000758799 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:57:37,872::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:57:37,880::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696387 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:57:38,567::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:57:38,575::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564571 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:57:39,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`dea457a5-4d63-4288-9e06-e6b10b5b8fef`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:57:39,460::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:57:39,460::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564571', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696387', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:57:39,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`dea457a5-4d63-4288-9e06-e6b10b5b8fef`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564571', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696387', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:57:39,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`dea457a5-4d63-4288-9e06-e6b10b5b8fef`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:57:39,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:57:39,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:57:39,461::task::993::Storage.TaskManager.Task::(_decref) Task=`dea457a5-4d63-4288-9e06-e6b10b5b8fef`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:57:47,886::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:57:47,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000808243 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:57:48,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:57:48,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632308 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:57:54,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`24c368d1-1aba-4889-a6d5-c3d3ee90a35f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:57:54,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:57:54,576::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632308', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808243', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:57:54,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`24c368d1-1aba-4889-a6d5-c3d3ee90a35f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632308', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808243', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:57:54,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`24c368d1-1aba-4889-a6d5-c3d3ee90a35f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:57:54,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:57:54,577::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:57:54,577::task::993::Storage.TaskManager.Task::(_decref) Task=`24c368d1-1aba-4889-a6d5-c3d3ee90a35f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:57:57,898::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:57:57,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000524702 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:57:58,588::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:57:58,596::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079943 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:58:07,909::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:07,917::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637569 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:08,598::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:08,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540657 s, 7.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:58:09,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce425c56-9219-4d8f-8337-d7e177e1e177`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:58:09,746::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:58:09,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540657', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637569', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:58:09,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce425c56-9219-4d8f-8337-d7e177e1e177`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540657', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637569', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:58:09,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce425c56-9219-4d8f-8337-d7e177e1e177`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:58:09,746::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:58:09,746::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:58:09,747::task::993::Storage.TaskManager.Task::(_decref) Task=`ce425c56-9219-4d8f-8337-d7e177e1e177`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:58:17,925::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:17,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679286 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:18,608::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:18,616::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676062 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:58:24,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b4b00c4-3406-4eab-a2b2-139666b42814`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:58:24,854::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:58:24,855::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676062', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679286', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:58:24,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b4b00c4-3406-4eab-a2b2-139666b42814`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676062', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679286', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:58:24,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b4b00c4-3406-4eab-a2b2-139666b42814`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:58:24,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:58:24,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:58:24,856::task::993::Storage.TaskManager.Task::(_decref) Task=`2b4b00c4-3406-4eab-a2b2-139666b42814`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:58:27,936::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:27,944::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623281 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:28,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:28,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624573 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:58:37,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:37,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669541 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:38,629::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:38,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579906 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:58:39,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fa04bfc-493d-4d57-9559-4666dcef91b8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:58:39,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:58:39,962::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579906', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669541', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:58:39,962::task::1191::Storage.TaskManager.Task::(prepare) Task=`6fa04bfc-493d-4d57-9559-4666dcef91b8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579906', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669541', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:58:39,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fa04bfc-493d-4d57-9559-4666dcef91b8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:58:39,963::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:58:39,963::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:58:39,963::task::993::Storage.TaskManager.Task::(_decref) Task=`6fa04bfc-493d-4d57-9559-4666dcef91b8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:58:47,960::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 16:58:47,960::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:58:47,960::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:47,970::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000581124 s, 3.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:58:47,971::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000581124 s, 3.5 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 16:58:47,971::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 16:58:47,971::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 16:58:47,971::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 16:58:47,971::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:58:47,972::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:58:47,972::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:58:47,972::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:58:47,972::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 16:58:47,973::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:48,252::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:58:48,253::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 16:58:48,253::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 16:58:48,254::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 16:58:48,254::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 16:58:48,255::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 16:58:48,255::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:48,429::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:58:48,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:48,438::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000517434 s, 7.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:48,639::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 16:58:48,639::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:58:48,640::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:48,648::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00057182 s, 3.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:48,648::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00057182 s, 3.6 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 16:58:48,648::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 16:58:48,648::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 16:58:48,649::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 16:58:48,649::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:58:48,649::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:58:48,649::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:58:48,650::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:58:48,650::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 16:58:48,650::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:48,827::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:48,828::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 16:58:48,828::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 16:58:48,829::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 16:58:48,830::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 16:58:48,830::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 16:58:48,830::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:48,999::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:48,999::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:49,007::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000517683 s, 7.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:58:55,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`a25adfc1-6a6b-4d2a-91a3-7c903330eda9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:58:55,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:58:55,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517683', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517434', 'lastCheck': '6.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:58:55,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`a25adfc1-6a6b-4d2a-91a3-7c903330eda9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517683', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517434', 'lastCheck': '6.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:58:55,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`a25adfc1-6a6b-4d2a-91a3-7c903330eda9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:58:55,085::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:58:55,085::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:58:55,085::task::993::Storage.TaskManager.Task::(_decref) Task=`a25adfc1-6a6b-4d2a-91a3-7c903330eda9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:58:58,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:58:58,449::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000563942 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:58:59,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:58:59,017::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648806 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:59:08,453::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:59:08,462::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601278 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:59:09,020::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:59:09,028::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643181 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:59:10,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`c632e8ab-bf06-414f-882f-89820a7e7199`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:59:10,469::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:59:10,469::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643181', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601278', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:59:10,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`c632e8ab-bf06-414f-882f-89820a7e7199`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643181', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601278', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:59:10,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`c632e8ab-bf06-414f-882f-89820a7e7199`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:59:10,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:59:10,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:59:10,470::task::993::Storage.TaskManager.Task::(_decref) Task=`c632e8ab-bf06-414f-882f-89820a7e7199`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:59:18,465::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:59:18,473::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621973 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:59:19,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:59:19,037::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572114 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:59:25,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`650c7d3d-3251-4c8f-b79d-17635535c54e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:59:25,625::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:59:25,625::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572114', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621973', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:59:25,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`650c7d3d-3251-4c8f-b79d-17635535c54e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572114', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621973', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:59:25,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`650c7d3d-3251-4c8f-b79d-17635535c54e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:59:25,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:59:25,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:59:25,626::task::993::Storage.TaskManager.Task::(_decref) Task=`650c7d3d-3251-4c8f-b79d-17635535c54e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:59:28,477::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:59:28,484::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000553912 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:59:29,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:59:29,047::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000519844 s, 7.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 16:59:38,488::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:59:38,496::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696805 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:59:39,049::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:59:39,057::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716117 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:59:40,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d9f3357-5dda-4871-a616-3297bebab412`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:59:40,773::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:59:40,774::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716117', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696805', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:59:40,774::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d9f3357-5dda-4871-a616-3297bebab412`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716117', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696805', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:59:40,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d9f3357-5dda-4871-a616-3297bebab412`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:59:40,774::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:59:40,774::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:59:40,775::task::993::Storage.TaskManager.Task::(_decref) Task=`8d9f3357-5dda-4871-a616-3297bebab412`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:59:48,499::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:59:48,507::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677192 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:59:49,059::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:59:49,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648306 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 16:59:55,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`f54da163-0cbe-4680-ab5f-162c9f63010f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 16:59:55,886::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 16:59:55,886::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648306', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677192', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:59:55,886::task::1191::Storage.TaskManager.Task::(prepare) Task=`f54da163-0cbe-4680-ab5f-162c9f63010f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648306', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677192', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 16:59:55,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`f54da163-0cbe-4680-ab5f-162c9f63010f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 16:59:55,887::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 16:59:55,887::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 16:59:55,887::task::993::Storage.TaskManager.Task::(_decref) Task=`f54da163-0cbe-4680-ab5f-162c9f63010f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 16:59:58,511::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 16:59:58,519::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000898528 s, 4.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 16:59:59,067::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 16:59:59,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757141 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:00:08,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:00:08,531::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660982 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:00:09,078::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:00:09,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593613 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:00:11,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`53269529-5e86-455c-93fe-0c694578d385`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:00:11,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:00:11,117::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593613', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660982', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:00:11,117::task::1191::Storage.TaskManager.Task::(prepare) Task=`53269529-5e86-455c-93fe-0c694578d385`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593613', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660982', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:00:11,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`53269529-5e86-455c-93fe-0c694578d385`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:00:11,118::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:00:11,118::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:00:11,118::task::993::Storage.TaskManager.Task::(_decref) Task=`53269529-5e86-455c-93fe-0c694578d385`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:00:18,536::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:00:18,544::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000745488 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:00:19,087::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:00:19,094::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635324 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:00:26,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e149a02-e3e5-4a89-844b-4f79a71391fc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:00:26,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:00:26,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635324', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745488', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:00:26,266::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e149a02-e3e5-4a89-844b-4f79a71391fc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635324', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745488', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:00:26,266::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e149a02-e3e5-4a89-844b-4f79a71391fc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:00:26,266::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:00:26,266::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:00:26,266::task::993::Storage.TaskManager.Task::(_decref) Task=`5e149a02-e3e5-4a89-844b-4f79a71391fc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:00:28,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:00:28,568::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608897 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:00:29,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:00:29,104::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673428 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:00:38,571::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:00:38,580::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728274 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:00:39,106::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:00:39,114::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613389 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:00:41,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4e78ec4-e3d9-4b21-80b2-29a822593451`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:00:41,387::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:00:41,388::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613389', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728274', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:00:41,388::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4e78ec4-e3d9-4b21-80b2-29a822593451`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613389', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728274', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:00:41,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4e78ec4-e3d9-4b21-80b2-29a822593451`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:00:41,388::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:00:41,388::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:00:41,389::task::993::Storage.TaskManager.Task::(_decref) Task=`d4e78ec4-e3d9-4b21-80b2-29a822593451`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:00:48,583::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:00:48,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665263 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:00:49,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:00:49,125::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060971 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:00:56,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`cffeae18-a85f-469f-b8a4-15f24fb41640`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:00:56,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:00:56,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060971', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665263', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:00:56,516::task::1191::Storage.TaskManager.Task::(prepare) Task=`cffeae18-a85f-469f-b8a4-15f24fb41640`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060971', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665263', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:00:56,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`cffeae18-a85f-469f-b8a4-15f24fb41640`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:00:56,516::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:00:56,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:00:56,516::task::993::Storage.TaskManager.Task::(_decref) Task=`cffeae18-a85f-469f-b8a4-15f24fb41640`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:00:58,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:00:58,613::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679537 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:00:59,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:00:59,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000901514 s, 4.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:01:08,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:01:08,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649011 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:01:09,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:01:09,145::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610892 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:01:11,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`b63ba8c9-76b9-4174-a3f6-fecd4938a447`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:01:11,647::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:01:11,647::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610892', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649011', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:01:11,647::task::1191::Storage.TaskManager.Task::(prepare) Task=`b63ba8c9-76b9-4174-a3f6-fecd4938a447`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610892', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649011', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:01:11,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`b63ba8c9-76b9-4174-a3f6-fecd4938a447`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:01:11,648::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:01:11,648::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:01:11,648::task::993::Storage.TaskManager.Task::(_decref) Task=`b63ba8c9-76b9-4174-a3f6-fecd4938a447`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:01:18,635::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:01:18,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639839 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:01:19,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:01:19,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678848 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:01:26,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8c7b17a-01fc-40cb-a2e7-59dcfabe5501`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:01:26,790::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:01:26,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678848', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639839', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:01:26,790::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8c7b17a-01fc-40cb-a2e7-59dcfabe5501`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678848', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639839', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:01:26,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8c7b17a-01fc-40cb-a2e7-59dcfabe5501`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:01:26,790::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:01:26,791::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:01:26,791::task::993::Storage.TaskManager.Task::(_decref) Task=`e8c7b17a-01fc-40cb-a2e7-59dcfabe5501`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:01:28,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:01:28,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633658 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:01:29,157::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:01:29,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709057 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:01:38,667::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:01:38,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657914 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:01:39,167::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:01:39,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633621 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:01:41,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`613aa77b-7606-4313-ae96-0d88c89503a4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:01:41,922::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:01:41,922::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633621', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657914', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:01:41,922::task::1191::Storage.TaskManager.Task::(prepare) Task=`613aa77b-7606-4313-ae96-0d88c89503a4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633621', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657914', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:01:41,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`613aa77b-7606-4313-ae96-0d88c89503a4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:01:41,923::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:01:41,923::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:01:41,923::task::993::Storage.TaskManager.Task::(_decref) Task=`613aa77b-7606-4313-ae96-0d88c89503a4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:01:48,679::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:01:48,688::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638011 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:01:49,177::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:01:49,186::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579279 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:01:57,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`70f16c93-a0e5-403c-a7c1-3ffbb5ee96b0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:01:57,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:01:57,028::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579279', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638011', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:01:57,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`70f16c93-a0e5-403c-a7c1-3ffbb5ee96b0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579279', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638011', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:01:57,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`70f16c93-a0e5-403c-a7c1-3ffbb5ee96b0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:01:57,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:01:57,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:01:57,029::task::993::Storage.TaskManager.Task::(_decref) Task=`70f16c93-a0e5-403c-a7c1-3ffbb5ee96b0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:01:58,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:01:58,699::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764434 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:01:59,188::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:01:59,196::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675692 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:02:08,702::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:02:08,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072568 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:02:09,198::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:02:09,206::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655109 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:02:12,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ff745c0-b241-4ac2-ad42-505f43184c0a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:02:12,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:02:12,148::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655109', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072568', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:02:12,148::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ff745c0-b241-4ac2-ad42-505f43184c0a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655109', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072568', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:02:12,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ff745c0-b241-4ac2-ad42-505f43184c0a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:02:12,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:02:12,148::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:02:12,148::task::993::Storage.TaskManager.Task::(_decref) Task=`6ff745c0-b241-4ac2-ad42-505f43184c0a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:02:18,714::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:02:18,722::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000854011 s, 4.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:02:19,208::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:02:19,216::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618044 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:02:27,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`968b07fc-d319-4f6f-9786-8400eef15077`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:02:27,250::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:02:27,250::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618044', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000854011', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:02:27,250::task::1191::Storage.TaskManager.Task::(prepare) Task=`968b07fc-d319-4f6f-9786-8400eef15077`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618044', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000854011', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:02:27,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`968b07fc-d319-4f6f-9786-8400eef15077`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:02:27,251::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:02:27,251::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:02:27,251::task::993::Storage.TaskManager.Task::(_decref) Task=`968b07fc-d319-4f6f-9786-8400eef15077`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:02:28,726::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:02:28,734::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669458 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:02:29,218::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:02:29,227::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760729 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:02:38,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:02:38,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074711 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:02:39,228::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:02:39,237::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643156 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:02:42,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`2682f64c-0fe7-4ffd-8fcd-24d9f74e259f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:02:42,366::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:02:42,366::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643156', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074711', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:02:42,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`2682f64c-0fe7-4ffd-8fcd-24d9f74e259f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643156', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074711', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:02:42,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`2682f64c-0fe7-4ffd-8fcd-24d9f74e259f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:02:42,367::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:02:42,367::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:02:42,367::task::993::Storage.TaskManager.Task::(_decref) Task=`2682f64c-0fe7-4ffd-8fcd-24d9f74e259f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:02:48,748::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:02:48,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660805 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:02:49,239::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:02:49,247::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661159 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:02:57,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae5d31fa-3b41-4d3a-8f4f-18611d74ab3e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:02:57,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:02:57,472::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661159', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660805', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:02:57,472::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae5d31fa-3b41-4d3a-8f4f-18611d74ab3e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661159', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660805', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:02:57,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae5d31fa-3b41-4d3a-8f4f-18611d74ab3e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:02:57,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:02:57,473::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:02:57,473::task::993::Storage.TaskManager.Task::(_decref) Task=`ae5d31fa-3b41-4d3a-8f4f-18611d74ab3e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:02:58,761::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:02:58,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695655 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:02:59,249::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:02:59,257::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630768 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:03:08,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:08,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664682 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:09,259::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:09,267::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613818 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:03:12,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`d34dc48c-17f3-4792-b7dc-ea835210b665`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:03:12,673::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:03:12,673::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613818', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664682', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:03:12,673::task::1191::Storage.TaskManager.Task::(prepare) Task=`d34dc48c-17f3-4792-b7dc-ea835210b665`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613818', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664682', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:03:12,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`d34dc48c-17f3-4792-b7dc-ea835210b665`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:03:12,674::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:03:12,674::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:03:12,674::task::993::Storage.TaskManager.Task::(_decref) Task=`d34dc48c-17f3-4792-b7dc-ea835210b665`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:03:18,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:18,793::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648344 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:19,269::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:19,277::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582773 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:03:27,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f24f73c-d88f-450e-b458-1e81b75443a0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:03:27,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:03:27,833::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582773', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648344', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:03:27,834::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f24f73c-d88f-450e-b458-1e81b75443a0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582773', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648344', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:03:27,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f24f73c-d88f-450e-b458-1e81b75443a0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:03:27,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:03:27,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:03:27,834::task::993::Storage.TaskManager.Task::(_decref) Task=`7f24f73c-d88f-450e-b458-1e81b75443a0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:03:28,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:28,807::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605433 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:29,279::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:29,288::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742053 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:03:38,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:38,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608205 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:39,296::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:39,303::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652246 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:03:42,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4bfbaaf-42b6-4af1-9acb-9f38e08ca6fe`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:03:42,941::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:03:42,941::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652246', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608205', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:03:42,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4bfbaaf-42b6-4af1-9acb-9f38e08ca6fe`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652246', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608205', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:03:42,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4bfbaaf-42b6-4af1-9acb-9f38e08ca6fe`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:03:42,941::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:03:42,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:03:42,942::task::993::Storage.TaskManager.Task::(_decref) Task=`e4bfbaaf-42b6-4af1-9acb-9f38e08ca6fe`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:03:48,823::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:03:48,823::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:03:48,823::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:48,832::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00135899 s, 1.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:03:48,833::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00135899 s, 1.5 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:03:48,833::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:03:48,833::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:03:48,833::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:03:48,833::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:03:48,834::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:03:48,834::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:03:48,834::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:03:48,834::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:03:48,835::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:49,112::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:03:49,112::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:03:49,113::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 17:03:49,114::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:03:49,114::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:03:49,114::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 17:03:49,114::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:49,281::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:03:49,281::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:49,290::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000570384 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:49,305::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:03:49,305::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:03:49,305::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:49,313::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000503059 s, 4.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:49,313::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000503059 s, 4.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:03:49,313::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:03:49,314::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:03:49,314::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:03:49,314::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:03:49,314::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:03:49,315::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:03:49,315::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:03:49,315::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:03:49,315::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:49,505::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:49,506::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:03:49,506::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:03:49,507::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:03:49,507::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:03:49,507::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:03:49,508::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:49,674::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:49,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:49,683::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000527471 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:03:58,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c43a8cd-01af-41c7-9885-e76e8afd3fd1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:03:58,065::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:03:58,065::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527471', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570384', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:03:58,065::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c43a8cd-01af-41c7-9885-e76e8afd3fd1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527471', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570384', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:03:58,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c43a8cd-01af-41c7-9885-e76e8afd3fd1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:03:58,066::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:03:58,066::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:03:58,066::task::993::Storage.TaskManager.Task::(_decref) Task=`1c43a8cd-01af-41c7-9885-e76e8afd3fd1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:03:59,294::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:03:59,302::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060475 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:03:59,685::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:03:59,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748995 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:04:09,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:04:09,314::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694959 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:04:09,695::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:04:09,704::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681147 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:04:13,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`589a63a5-57d2-472d-8d1e-7968c58c7dde`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:04:13,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:04:13,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681147', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694959', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:04:13,195::task::1191::Storage.TaskManager.Task::(prepare) Task=`589a63a5-57d2-472d-8d1e-7968c58c7dde`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681147', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694959', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:04:13,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`589a63a5-57d2-472d-8d1e-7968c58c7dde`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:04:13,195::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:04:13,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:04:13,195::task::993::Storage.TaskManager.Task::(_decref) Task=`589a63a5-57d2-472d-8d1e-7968c58c7dde`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:04:19,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:04:19,326::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068206 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:04:19,705::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:04:19,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639644 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:04:28,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e52a96b-4f06-450f-93b8-18c53fced7a1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:04:28,296::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:04:28,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639644', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068206', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:04:28,297::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e52a96b-4f06-450f-93b8-18c53fced7a1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639644', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068206', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:04:28,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e52a96b-4f06-450f-93b8-18c53fced7a1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:04:28,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:04:28,297::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:04:28,297::task::993::Storage.TaskManager.Task::(_decref) Task=`6e52a96b-4f06-450f-93b8-18c53fced7a1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:04:29,329::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:04:29,337::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732196 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:04:29,727::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:04:29,735::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752426 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:04:39,340::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:04:39,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631306 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:04:39,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:04:39,744::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057011 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:04:43,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`be40b2dc-af20-4477-9d71-1cbe7591b870`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:04:43,401::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:04:43,401::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057011', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631306', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:04:43,401::task::1191::Storage.TaskManager.Task::(prepare) Task=`be40b2dc-af20-4477-9d71-1cbe7591b870`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057011', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631306', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:04:43,402::task::595::Storage.TaskManager.Task::(_updateState) Task=`be40b2dc-af20-4477-9d71-1cbe7591b870`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:04:43,402::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:04:43,402::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:04:43,402::task::993::Storage.TaskManager.Task::(_decref) Task=`be40b2dc-af20-4477-9d71-1cbe7591b870`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:04:49,353::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:04:49,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653035 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:04:49,746::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:04:49,754::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649826 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:04:58,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7030e30-921e-4c50-a0b1-aedcfb39001e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:04:58,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:04:58,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649826', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653035', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:04:58,518::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7030e30-921e-4c50-a0b1-aedcfb39001e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649826', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653035', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:04:58,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7030e30-921e-4c50-a0b1-aedcfb39001e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:04:58,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:04:58,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:04:58,518::task::993::Storage.TaskManager.Task::(_decref) Task=`f7030e30-921e-4c50-a0b1-aedcfb39001e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:04:59,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:04:59,373::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569054 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:04:59,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:04:59,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062686 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:05:09,377::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:05:09,385::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806954 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:05:09,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:05:09,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682999 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:05:13,633::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bdc681a-faea-411e-ad37-907e0194e1fb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:05:13,634::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:05:13,634::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682999', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806954', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:05:13,634::task::1191::Storage.TaskManager.Task::(prepare) Task=`1bdc681a-faea-411e-ad37-907e0194e1fb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682999', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806954', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:05:13,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bdc681a-faea-411e-ad37-907e0194e1fb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:05:13,635::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:05:13,635::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:05:13,635::task::993::Storage.TaskManager.Task::(_decref) Task=`1bdc681a-faea-411e-ad37-907e0194e1fb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:05:19,388::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:05:19,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660821 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:05:19,781::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:05:19,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636181 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:05:28,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`99872bdf-d850-4f93-acb0-5ab187152fea`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:05:28,749::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:05:28,749::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636181', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660821', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:05:28,750::task::1191::Storage.TaskManager.Task::(prepare) Task=`99872bdf-d850-4f93-acb0-5ab187152fea`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636181', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660821', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:05:28,750::task::595::Storage.TaskManager.Task::(_updateState) Task=`99872bdf-d850-4f93-acb0-5ab187152fea`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:05:28,750::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:05:28,750::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:05:28,750::task::993::Storage.TaskManager.Task::(_decref) Task=`99872bdf-d850-4f93-acb0-5ab187152fea`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:05:29,400::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:05:29,408::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629387 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:05:29,790::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:05:29,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706417 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:05:39,411::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:05:39,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686817 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:05:39,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:05:39,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621949 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:05:43,870::task::595::Storage.TaskManager.Task::(_updateState) Task=`03e32353-1948-49a0-aa86-a09219ed1d48`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:05:43,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:05:43,871::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621949', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686817', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:05:43,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`03e32353-1948-49a0-aa86-a09219ed1d48`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621949', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686817', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:05:43,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`03e32353-1948-49a0-aa86-a09219ed1d48`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:05:43,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:05:43,872::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:05:43,872::task::993::Storage.TaskManager.Task::(_decref) Task=`03e32353-1948-49a0-aa86-a09219ed1d48`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:05:49,423::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:05:49,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728566 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:05:49,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:05:49,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694098 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:05:58,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3ec3ffb-0f6f-4fe5-a84f-0cc7c6972da4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:05:58,977::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:05:58,977::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694098', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728566', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:05:58,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3ec3ffb-0f6f-4fe5-a84f-0cc7c6972da4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694098', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728566', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:05:58,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3ec3ffb-0f6f-4fe5-a84f-0cc7c6972da4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:05:58,978::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:05:58,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:05:58,978::task::993::Storage.TaskManager.Task::(_decref) Task=`a3ec3ffb-0f6f-4fe5-a84f-0cc7c6972da4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:05:59,435::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:05:59,444::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000555554 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:05:59,824::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:05:59,833::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673578 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:06:09,447::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:06:09,456::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683239 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:06:09,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:06:09,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601083 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:06:14,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`fab0a827-78de-4f25-993a-17d6c491987f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:06:14,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:06:14,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601083', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683239', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:06:14,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`fab0a827-78de-4f25-993a-17d6c491987f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601083', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683239', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:06:14,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`fab0a827-78de-4f25-993a-17d6c491987f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:06:14,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:06:14,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:06:14,094::task::993::Storage.TaskManager.Task::(_decref) Task=`fab0a827-78de-4f25-993a-17d6c491987f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:06:19,459::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:06:19,468::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594543 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:06:19,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:06:19,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000511375 s, 8.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:06:29,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`22e24f11-937b-4db9-9d82-3dd1d1eb9cec`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:06:29,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:06:29,215::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511375', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594543', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:06:29,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`22e24f11-937b-4db9-9d82-3dd1d1eb9cec`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511375', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594543', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:06:29,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`22e24f11-937b-4db9-9d82-3dd1d1eb9cec`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:06:29,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:06:29,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:06:29,216::task::993::Storage.TaskManager.Task::(_decref) Task=`22e24f11-937b-4db9-9d82-3dd1d1eb9cec`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:06:29,471::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:06:29,479::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060904 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:06:29,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:06:29,864::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582383 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:06:39,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:06:39,491::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707326 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:06:39,865::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:06:39,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750153 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:06:44,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c861220-1808-4e7a-867e-a24afae2bb75`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:06:44,327::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:06:44,327::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750153', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707326', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:06:44,328::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c861220-1808-4e7a-867e-a24afae2bb75`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750153', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707326', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:06:44,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c861220-1808-4e7a-867e-a24afae2bb75`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:06:44,328::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:06:44,328::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:06:44,328::task::993::Storage.TaskManager.Task::(_decref) Task=`4c861220-1808-4e7a-867e-a24afae2bb75`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:06:49,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:06:49,504::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635427 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:06:49,874::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:06:49,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770963 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:06:59,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`eef10094-9a4c-442a-8c89-431444f0c475`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:06:59,432::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:06:59,433::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770963', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635427', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:06:59,433::task::1191::Storage.TaskManager.Task::(prepare) Task=`eef10094-9a4c-442a-8c89-431444f0c475`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770963', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635427', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:06:59,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`eef10094-9a4c-442a-8c89-431444f0c475`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:06:59,433::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:06:59,433::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:06:59,434::task::993::Storage.TaskManager.Task::(_decref) Task=`eef10094-9a4c-442a-8c89-431444f0c475`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:06:59,507::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:06:59,515::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604776 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:06:59,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:06:59,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800674 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:07:09,519::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:07:09,527::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641485 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:07:09,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:07:09,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653437 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:07:14,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fff5545-4b3d-4c31-8765-d7ffd5a3fa94`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:07:14,542::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:07:14,542::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653437', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641485', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:07:14,542::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fff5545-4b3d-4c31-8765-d7ffd5a3fa94`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653437', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641485', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:07:14,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fff5545-4b3d-4c31-8765-d7ffd5a3fa94`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:07:14,542::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:07:14,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:07:14,543::task::993::Storage.TaskManager.Task::(_decref) Task=`9fff5545-4b3d-4c31-8765-d7ffd5a3fa94`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:07:19,531::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:07:19,539::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674346 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:07:19,904::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:07:19,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061552 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:07:29,542::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:07:29,550::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586447 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:07:29,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`298f5c37-fbd2-49aa-8223-f1009718a1c6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:07:29,645::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:07:29,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061552', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586447', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:07:29,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`298f5c37-fbd2-49aa-8223-f1009718a1c6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061552', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586447', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:07:29,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`298f5c37-fbd2-49aa-8223-f1009718a1c6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:07:29,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:07:29,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:07:29,646::task::993::Storage.TaskManager.Task::(_decref) Task=`298f5c37-fbd2-49aa-8223-f1009718a1c6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 17:07:29,915::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:07:29,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735146 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:07:39,554::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:07:39,562::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677625 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:07:39,927::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:07:39,936::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616653 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:07:44,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`adce898d-350b-4101-9a6e-093d5e0624fc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:07:44,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:07:44,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616653', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677625', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:07:44,848::task::1191::Storage.TaskManager.Task::(prepare) Task=`adce898d-350b-4101-9a6e-093d5e0624fc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616653', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677625', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:07:44,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`adce898d-350b-4101-9a6e-093d5e0624fc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:07:44,849::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:07:44,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:07:44,849::task::993::Storage.TaskManager.Task::(_decref) Task=`adce898d-350b-4101-9a6e-093d5e0624fc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:07:49,566::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:07:49,576::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714393 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:07:49,938::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:07:49,946::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618878 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:07:59,589::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:07:59,597::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000573525 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:07:59,947::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:07:59,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000525835 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:07:59,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`d82b25d1-d233-4b71-bafb-b6fdd101b6fb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:07:59,990::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:07:59,990::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525835', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573525', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:07:59,990::task::1191::Storage.TaskManager.Task::(prepare) Task=`d82b25d1-d233-4b71-bafb-b6fdd101b6fb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525835', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573525', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:07:59,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`d82b25d1-d233-4b71-bafb-b6fdd101b6fb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:07:59,991::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:07:59,991::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:07:59,991::task::993::Storage.TaskManager.Task::(_decref) Task=`d82b25d1-d233-4b71-bafb-b6fdd101b6fb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:08:09,600::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:08:09,609::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653021 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:08:09,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:08:09,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608846 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:08:15,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca16dd44-2037-4495-bbdf-2804fb637359`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:08:15,098::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:08:15,098::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608846', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653021', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:08:15,098::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca16dd44-2037-4495-bbdf-2804fb637359`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608846', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653021', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:08:15,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca16dd44-2037-4495-bbdf-2804fb637359`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:08:15,098::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:08:15,099::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:08:15,099::task::993::Storage.TaskManager.Task::(_decref) Task=`ca16dd44-2037-4495-bbdf-2804fb637359`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:08:19,612::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:08:19,621::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000547196 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:08:19,967::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:08:19,974::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670275 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:08:29,624::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:08:29,632::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657974 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:08:29,975::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:08:29,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635974 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:08:30,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d0adbe5-10e1-4bec-8c23-b68297f418ad`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:08:30,214::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:08:30,214::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635974', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657974', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:08:30,214::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d0adbe5-10e1-4bec-8c23-b68297f418ad`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635974', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657974', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:08:30,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d0adbe5-10e1-4bec-8c23-b68297f418ad`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:08:30,215::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:08:30,215::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:08:30,215::task::993::Storage.TaskManager.Task::(_decref) Task=`3d0adbe5-10e1-4bec-8c23-b68297f418ad`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:08:39,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:08:39,645::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00138988 s, 2.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:08:39,986::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:08:39,995::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615493 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:08:45,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a538083-fd1e-4a2a-a20e-43218d4ca00e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:08:45,317::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:08:45,318::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615493', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138988', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:08:45,318::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a538083-fd1e-4a2a-a20e-43218d4ca00e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615493', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138988', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:08:45,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a538083-fd1e-4a2a-a20e-43218d4ca00e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:08:45,318::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:08:45,318::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:08:45,319::task::993::Storage.TaskManager.Task::(_decref) Task=`5a538083-fd1e-4a2a-a20e-43218d4ca00e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:08:49,648::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:08:49,648::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:08:49,649::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:08:49,657::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000621532 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:08:49,657::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000621532 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:08:49,658::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:08:49,658::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:08:49,658::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:08:49,658::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:08:49,659::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:08:49,659::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:08:49,659::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:08:49,660::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:08:49,660::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 17:08:49,913::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:08:49,913::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:08:49,914::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 17:08:49,915::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:08:49,915::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:08:49,915::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 17:08:49,915::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:08:49,996::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:08:49,996::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:08:49,997::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:08:50,005::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000575668 s, 3.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:08:50,006::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000575668 s, 3.6 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:08:50,006::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:08:50,006::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:08:50,006::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:08:50,007::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:08:50,007::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:08:50,007::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:08:50,007::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:08:50,008::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:08:50,008::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:08:50,083::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:08:50,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:08:50,092::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645872 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:08:50,184::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:08:50,185::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:08:50,185::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:08:50,186::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:08:50,186::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:08:50,186::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:08:50,187::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:08:50,354::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:08:50,354::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:08:50,362::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000551634 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:09:00,096::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:09:00,104::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595527 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:09:00,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:09:00,373::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658532 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:09:00,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`db1a1ff3-b462-4a85-8f87-3629f5660800`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:09:00,424::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:09:00,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658532', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595527', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:09:00,425::task::1191::Storage.TaskManager.Task::(prepare) Task=`db1a1ff3-b462-4a85-8f87-3629f5660800`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658532', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595527', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:09:00,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`db1a1ff3-b462-4a85-8f87-3629f5660800`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:09:00,425::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:09:00,425::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:09:00,426::task::993::Storage.TaskManager.Task::(_decref) Task=`db1a1ff3-b462-4a85-8f87-3629f5660800`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:09:10,107::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:09:10,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631171 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:09:10,375::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:09:10,382::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605848 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:09:15,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b122a41-29ef-4d43-9158-35ffa4dea71b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:09:15,537::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:09:15,537::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605848', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631171', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:09:15,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b122a41-29ef-4d43-9158-35ffa4dea71b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605848', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631171', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:09:15,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b122a41-29ef-4d43-9158-35ffa4dea71b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:09:15,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:09:15,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:09:15,538::task::993::Storage.TaskManager.Task::(_decref) Task=`3b122a41-29ef-4d43-9158-35ffa4dea71b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:09:20,119::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:09:20,128::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061316 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:09:20,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:09:20,394::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533584 s, 7.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:09:30,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:09:30,140::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066738 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:09:30,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:09:30,404::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760467 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:09:30,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0318e84-2bed-415b-a233-c856b60de64c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:09:30,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:09:30,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760467', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066738', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:09:30,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0318e84-2bed-415b-a233-c856b60de64c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760467', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066738', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:09:30,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0318e84-2bed-415b-a233-c856b60de64c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:09:30,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:09:30,663::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:09:30,663::task::993::Storage.TaskManager.Task::(_decref) Task=`d0318e84-2bed-415b-a233-c856b60de64c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:09:40,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:09:40,151::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680732 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:09:40,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:09:40,413::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636865 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:09:45,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`c81a1798-f3da-4a9a-a6a0-02b2a09f9569`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:09:45,772::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:09:45,772::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636865', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680732', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:09:45,772::task::1191::Storage.TaskManager.Task::(prepare) Task=`c81a1798-f3da-4a9a-a6a0-02b2a09f9569`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636865', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680732', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:09:45,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`c81a1798-f3da-4a9a-a6a0-02b2a09f9569`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:09:45,772::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:09:45,773::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:09:45,773::task::993::Storage.TaskManager.Task::(_decref) Task=`c81a1798-f3da-4a9a-a6a0-02b2a09f9569`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:09:50,154::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:09:50,163::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647283 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:09:50,415::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:09:50,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640447 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:10:00,167::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:10:00,174::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063522 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:10:00,426::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:10:00,435::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685936 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:10:00,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce3714e0-0be8-4c12-a012-64b8136cdf91`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:10:00,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:10:00,892::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685936', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063522', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:10:00,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce3714e0-0be8-4c12-a012-64b8136cdf91`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685936', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063522', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:10:00,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce3714e0-0be8-4c12-a012-64b8136cdf91`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:10:00,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:10:00,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:10:00,893::task::993::Storage.TaskManager.Task::(_decref) Task=`ce3714e0-0be8-4c12-a012-64b8136cdf91`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:10:10,178::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:10:10,188::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000789486 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:10:10,436::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:10:10,444::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613574 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:10:16,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`bea913f1-4686-4bb5-b318-5d160d032047`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:10:16,003::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:10:16,003::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613574', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789486', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:10:16,003::task::1191::Storage.TaskManager.Task::(prepare) Task=`bea913f1-4686-4bb5-b318-5d160d032047`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613574', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000789486', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:10:16,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`bea913f1-4686-4bb5-b318-5d160d032047`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:10:16,004::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:10:16,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:10:16,004::task::993::Storage.TaskManager.Task::(_decref) Task=`bea913f1-4686-4bb5-b318-5d160d032047`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:10:20,192::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:10:20,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658472 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:10:20,446::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:10:20,454::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713006 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:10:30,212::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:10:30,220::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006496 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:10:30,456::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:10:30,464::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694973 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:10:31,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5beea9f-74c4-440b-8e1e-51524babfd8d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:10:31,114::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:10:31,114::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694973', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006496', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:10:31,114::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5beea9f-74c4-440b-8e1e-51524babfd8d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694973', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006496', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:10:31,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5beea9f-74c4-440b-8e1e-51524babfd8d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:10:31,114::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:10:31,115::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:10:31,115::task::993::Storage.TaskManager.Task::(_decref) Task=`f5beea9f-74c4-440b-8e1e-51524babfd8d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:10:40,224::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:10:40,232::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712189 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:10:40,466::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:10:40,475::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669938 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:10:46,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`9548ca07-d410-45d6-ad42-06ca13b02d52`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:10:46,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:10:46,216::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669938', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712189', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:10:46,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`9548ca07-d410-45d6-ad42-06ca13b02d52`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669938', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712189', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:10:46,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`9548ca07-d410-45d6-ad42-06ca13b02d52`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:10:46,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:10:46,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:10:46,216::task::993::Storage.TaskManager.Task::(_decref) Task=`9548ca07-d410-45d6-ad42-06ca13b02d52`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:10:50,235::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:10:50,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080361 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:10:50,477::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:10:50,484::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614078 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:11:00,247::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:11:00,255::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620007 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:11:00,485::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:11:00,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737741 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:11:01,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`5aceaa93-31a3-476c-a347-9d3bc40c98af`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:11:01,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:11:01,322::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737741', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620007', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:11:01,322::task::1191::Storage.TaskManager.Task::(prepare) Task=`5aceaa93-31a3-476c-a347-9d3bc40c98af`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737741', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620007', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:11:01,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`5aceaa93-31a3-476c-a347-9d3bc40c98af`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:11:01,322::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:11:01,322::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:11:01,322::task::993::Storage.TaskManager.Task::(_decref) Task=`5aceaa93-31a3-476c-a347-9d3bc40c98af`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:11:10,258::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:11:10,267::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692962 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:11:10,495::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:11:10,504::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061473 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:11:16,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9cf7cee-344b-40f7-b0e3-a87407223982`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:11:16,543::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:11:16,543::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061473', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692962', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:11:16,543::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9cf7cee-344b-40f7-b0e3-a87407223982`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061473', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692962', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:11:16,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9cf7cee-344b-40f7-b0e3-a87407223982`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:11:16,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:11:16,544::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:11:16,544::task::993::Storage.TaskManager.Task::(_decref) Task=`d9cf7cee-344b-40f7-b0e3-a87407223982`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:11:20,270::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:11:20,278::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582817 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:11:20,505::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:11:20,513::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637407 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:11:30,281::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:11:30,290::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641075 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:11:30,514::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:11:30,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677454 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:11:31,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`47cdb41b-1fdd-4fa8-b7f2-5ee5d6468b52`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:11:31,657::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:11:31,657::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677454', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641075', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:11:31,657::task::1191::Storage.TaskManager.Task::(prepare) Task=`47cdb41b-1fdd-4fa8-b7f2-5ee5d6468b52`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677454', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641075', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:11:31,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`47cdb41b-1fdd-4fa8-b7f2-5ee5d6468b52`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:11:31,657::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:11:31,658::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:11:31,658::task::993::Storage.TaskManager.Task::(_decref) Task=`47cdb41b-1fdd-4fa8-b7f2-5ee5d6468b52`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:11:40,293::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:11:40,302::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731855 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:11:40,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:11:40,536::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604021 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:11:46,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`03acd4d4-50b9-467c-a7bd-5a80e5854593`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:11:46,769::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:11:46,769::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604021', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731855', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:11:46,770::task::1191::Storage.TaskManager.Task::(prepare) Task=`03acd4d4-50b9-467c-a7bd-5a80e5854593`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604021', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731855', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:11:46,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`03acd4d4-50b9-467c-a7bd-5a80e5854593`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:11:46,770::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:11:46,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:11:46,770::task::993::Storage.TaskManager.Task::(_decref) Task=`03acd4d4-50b9-467c-a7bd-5a80e5854593`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:11:50,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:11:50,314::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627551 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:11:50,540::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:11:50,548::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572535 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:12:00,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:12:00,326::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597288 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:12:00,550::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:12:00,559::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753775 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:12:01,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`77cc53b7-b87a-4f5e-94ed-c9a020c734c7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:12:01,891::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:12:01,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753775', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597288', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:12:01,891::task::1191::Storage.TaskManager.Task::(prepare) Task=`77cc53b7-b87a-4f5e-94ed-c9a020c734c7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753775', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597288', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:12:01,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`77cc53b7-b87a-4f5e-94ed-c9a020c734c7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:12:01,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:12:01,892::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:12:01,892::task::993::Storage.TaskManager.Task::(_decref) Task=`77cc53b7-b87a-4f5e-94ed-c9a020c734c7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:12:10,329::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:12:10,337::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673758 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:12:10,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:12:10,569::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676596 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:12:16,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`a278afee-5343-4416-9f9d-8c6054ca82c1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:12:16,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:12:16,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676596', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673758', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:12:16,997::task::1191::Storage.TaskManager.Task::(prepare) Task=`a278afee-5343-4416-9f9d-8c6054ca82c1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676596', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673758', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:12:16,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`a278afee-5343-4416-9f9d-8c6054ca82c1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:12:16,997::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:12:16,998::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:12:16,998::task::993::Storage.TaskManager.Task::(_decref) Task=`a278afee-5343-4416-9f9d-8c6054ca82c1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:12:20,341::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:12:20,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711076 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:12:20,570::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:12:20,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671702 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:12:30,353::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:12:30,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604447 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:12:30,579::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:12:30,587::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000691558 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:12:32,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`2005dbc7-7481-4413-961e-40638b96ba80`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:12:32,119::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:12:32,119::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691558', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604447', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:12:32,120::task::1191::Storage.TaskManager.Task::(prepare) Task=`2005dbc7-7481-4413-961e-40638b96ba80`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691558', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604447', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:12:32,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`2005dbc7-7481-4413-961e-40638b96ba80`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:12:32,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:12:32,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:12:32,120::task::993::Storage.TaskManager.Task::(_decref) Task=`2005dbc7-7481-4413-961e-40638b96ba80`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:12:40,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:12:40,372::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633502 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:12:40,589::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:12:40,597::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528795 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:12:47,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`7464c000-9151-4db3-8bca-8250006c2d6d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:12:47,221::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:12:47,221::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528795', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633502', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:12:47,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`7464c000-9151-4db3-8bca-8250006c2d6d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528795', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633502', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:12:47,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`7464c000-9151-4db3-8bca-8250006c2d6d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:12:47,222::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:12:47,222::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:12:47,222::task::993::Storage.TaskManager.Task::(_decref) Task=`7464c000-9151-4db3-8bca-8250006c2d6d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:12:50,375::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:12:50,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693402 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:12:50,599::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:12:50,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000525152 s, 7.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:13:00,387::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:13:00,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601652 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:00,609::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:00,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00082539 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:13:02,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cdd599d-bd50-4b71-9714-260fbd61b0bb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:13:02,333::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:13:02,333::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00082539', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601652', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:13:02,333::task::1191::Storage.TaskManager.Task::(prepare) Task=`2cdd599d-bd50-4b71-9714-260fbd61b0bb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00082539', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601652', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:13:02,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cdd599d-bd50-4b71-9714-260fbd61b0bb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:13:02,334::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:13:02,334::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:13:02,334::task::993::Storage.TaskManager.Task::(_decref) Task=`2cdd599d-bd50-4b71-9714-260fbd61b0bb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:13:10,398::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:13:10,407::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637497 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:10,619::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:10,628::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582452 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:13:17,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0e72541-83be-4c42-833e-adbb481a8cc4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:13:17,446::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:13:17,446::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582452', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637497', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:13:17,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0e72541-83be-4c42-833e-adbb481a8cc4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582452', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637497', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:13:17,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0e72541-83be-4c42-833e-adbb481a8cc4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:13:17,447::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:13:17,447::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:13:17,447::task::993::Storage.TaskManager.Task::(_decref) Task=`c0e72541-83be-4c42-833e-adbb481a8cc4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:13:20,410::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:13:20,418::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748705 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:20,629::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:20,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659864 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:13:30,422::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:13:30,429::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655207 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:30,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:30,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719114 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:13:32,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaa75af9-e7b4-4646-88f1-60650aa37dfd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:13:32,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:13:32,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719114', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655207', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:13:32,559::task::1191::Storage.TaskManager.Task::(prepare) Task=`eaa75af9-e7b4-4646-88f1-60650aa37dfd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719114', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655207', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:13:32,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaa75af9-e7b4-4646-88f1-60650aa37dfd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:13:32,559::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:13:32,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:13:32,560::task::993::Storage.TaskManager.Task::(_decref) Task=`eaa75af9-e7b4-4646-88f1-60650aa37dfd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:13:40,433::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:13:40,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651202 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:40,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:40,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694729 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:13:47,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bbc5aa9-2084-49fa-9af0-6a7601e40d9e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:13:47,733::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:13:47,733::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694729', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651202', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:13:47,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`4bbc5aa9-2084-49fa-9af0-6a7601e40d9e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694729', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651202', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:13:47,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bbc5aa9-2084-49fa-9af0-6a7601e40d9e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:13:47,734::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:13:47,734::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:13:47,734::task::993::Storage.TaskManager.Task::(_decref) Task=`4bbc5aa9-2084-49fa-9af0-6a7601e40d9e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:13:50,444::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:13:50,445::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:13:50,445::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:13:50,454::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000579881 s, 3.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:13:50,454::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000579881 s, 3.5 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:13:50,454::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:13:50,455::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:13:50,455::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:13:50,455::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:13:50,455::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:13:50,456::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:13:50,456::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:13:50,456::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:13:50,456::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:50,658::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:13:50,659::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:13:50,659::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:50,669::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000400734 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:50,669::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000400734 s, 5.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:13:50,669::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:13:50,670::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:13:50,670::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:13:50,670::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:13:50,723::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:13:50,723::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:13:50,724::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:13:50,725::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:13:50,727::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:13:50,728::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:13:50,729::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:13:50,730::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:13:50,730::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:13:50,732::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:50,741::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:13:50,741::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:13:50,741::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:13:50,909::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:13:50,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:13:50,919::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00123322 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:50,922::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:50,923::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:13:50,923::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:13:50,924::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:13:50,924::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:13:50,924::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:13:50,924::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:51,092::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:13:51,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:13:51,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000538159 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:14:00,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:14:00,930::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576474 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:14:01,103::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:14:01,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679325 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:14:02,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d97f3e9-d21f-401b-9e45-22b78af7236b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:14:02,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:14:02,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679325', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576474', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:14:02,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d97f3e9-d21f-401b-9e45-22b78af7236b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679325', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576474', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:14:02,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d97f3e9-d21f-401b-9e45-22b78af7236b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:14:02,843::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:14:02,844::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:14:02,844::task::993::Storage.TaskManager.Task::(_decref) Task=`3d97f3e9-d21f-401b-9e45-22b78af7236b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:14:10,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:14:10,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674209 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:14:11,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:14:11,125::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580522 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:14:17,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`16d8f4aa-fea7-49e7-b6c2-de151ff1a835`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:14:17,961::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:14:17,961::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580522', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674209', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:14:17,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`16d8f4aa-fea7-49e7-b6c2-de151ff1a835`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580522', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674209', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:14:17,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`16d8f4aa-fea7-49e7-b6c2-de151ff1a835`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:14:17,962::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:14:17,962::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:14:17,962::task::993::Storage.TaskManager.Task::(_decref) Task=`16d8f4aa-fea7-49e7-b6c2-de151ff1a835`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:14:20,945::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:14:20,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645766 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:14:21,126::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:14:21,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00128486 s, 3.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:14:30,958::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:14:30,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661332 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:14:31,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:14:31,145::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610728 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:14:33,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`b029246d-bf38-4476-8f59-6247b6d22895`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:14:33,061::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:14:33,061::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610728', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661332', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:14:33,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`b029246d-bf38-4476-8f59-6247b6d22895`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610728', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661332', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:14:33,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`b029246d-bf38-4476-8f59-6247b6d22895`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:14:33,061::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:14:33,062::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:14:33,062::task::993::Storage.TaskManager.Task::(_decref) Task=`b029246d-bf38-4476-8f59-6247b6d22895`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:14:40,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:14:40,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000744163 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:14:41,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:14:41,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682503 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:14:48,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb7fc629-f58d-40a5-95f0-b7a5fda3a70b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:14:48,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:14:48,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682503', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744163', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:14:48,170::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb7fc629-f58d-40a5-95f0-b7a5fda3a70b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682503', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744163', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:14:48,170::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb7fc629-f58d-40a5-95f0-b7a5fda3a70b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:14:48,170::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:14:48,170::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:14:48,170::task::993::Storage.TaskManager.Task::(_decref) Task=`eb7fc629-f58d-40a5-95f0-b7a5fda3a70b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:14:50,981::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:14:50,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635838 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:14:51,157::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:14:51,166::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000515147 s, 8.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:15:00,994::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:15:01,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703268 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:15:01,167::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:15:01,176::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690204 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:15:03,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`9314efb6-6fb5-4525-832b-efab46fcec86`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:15:03,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:15:03,279::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690204', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703268', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:15:03,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`9314efb6-6fb5-4525-832b-efab46fcec86`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690204', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703268', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:15:03,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`9314efb6-6fb5-4525-832b-efab46fcec86`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:15:03,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:15:03,280::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:15:03,280::task::993::Storage.TaskManager.Task::(_decref) Task=`9314efb6-6fb5-4525-832b-efab46fcec86`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:15:11,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:15:11,015::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619664 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:15:11,177::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:15:11,185::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000531067 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:15:18,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eef3f50-4b09-49bd-a8af-1e9f7078bd6c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:15:18,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:15:18,387::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531067', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619664', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:15:18,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`4eef3f50-4b09-49bd-a8af-1e9f7078bd6c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531067', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619664', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:15:18,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eef3f50-4b09-49bd-a8af-1e9f7078bd6c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:15:18,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:15:18,387::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:15:18,388::task::993::Storage.TaskManager.Task::(_decref) Task=`4eef3f50-4b09-49bd-a8af-1e9f7078bd6c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:15:21,018::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:15:21,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0142184 s, 288 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:15:21,187::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:15:21,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640288 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:15:31,044::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:15:31,051::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000482271 s, 8.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:15:31,196::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:15:31,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813083 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:15:33,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`210ac43d-4089-42d9-ad50-6ad298cd8642`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:15:33,494::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:15:33,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813083', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482271', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:15:33,495::task::1191::Storage.TaskManager.Task::(prepare) Task=`210ac43d-4089-42d9-ad50-6ad298cd8642`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813083', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482271', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:15:33,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`210ac43d-4089-42d9-ad50-6ad298cd8642`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:15:33,495::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:15:33,495::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:15:33,495::task::993::Storage.TaskManager.Task::(_decref) Task=`210ac43d-4089-42d9-ad50-6ad298cd8642`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:15:41,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:15:41,064::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621325 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:15:41,207::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:15:41,215::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630556 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:15:48,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`dae4c715-d01d-4a24-8152-e1679c024994`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:15:48,600::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:15:48,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630556', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621325', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:15:48,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`dae4c715-d01d-4a24-8152-e1679c024994`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630556', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621325', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:15:48,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`dae4c715-d01d-4a24-8152-e1679c024994`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:15:48,601::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:15:48,601::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:15:48,601::task::993::Storage.TaskManager.Task::(_decref) Task=`dae4c715-d01d-4a24-8152-e1679c024994`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:15:51,067::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:15:51,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000543701 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:15:51,216::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:15:51,226::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000836566 s, 4.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:16:01,080::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:16:01,088::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627664 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:16:01,227::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:16:01,236::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800951 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:16:03,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0ab9edf-cd0e-4188-b4b3-bfbd3114b11d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:16:03,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:16:03,708::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800951', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627664', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:16:03,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0ab9edf-cd0e-4188-b4b3-bfbd3114b11d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800951', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627664', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:16:03,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0ab9edf-cd0e-4188-b4b3-bfbd3114b11d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:16:03,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:16:03,708::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:16:03,709::task::993::Storage.TaskManager.Task::(_decref) Task=`e0ab9edf-cd0e-4188-b4b3-bfbd3114b11d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:16:11,091::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:16:11,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0158593 s, 258 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:16:11,238::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:16:11,246::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588315 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:16:18,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef762e6b-4f11-403b-8b36-04901de61a65`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:16:18,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:16:18,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588315', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0158593', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:16:18,825::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef762e6b-4f11-403b-8b36-04901de61a65`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588315', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0158593', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:16:18,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef762e6b-4f11-403b-8b36-04901de61a65`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:16:18,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:16:18,825::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:16:18,825::task::993::Storage.TaskManager.Task::(_decref) Task=`ef762e6b-4f11-403b-8b36-04901de61a65`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:16:21,119::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:16:21,128::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645127 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:16:21,247::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:16:21,256::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609084 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:16:31,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:16:31,140::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00053817 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:16:31,258::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:16:31,267::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692739 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:16:33,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d21fe0c-bc4f-440c-a2a2-0eca92fab3fd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:16:33,932::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:16:33,933::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692739', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053817', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:16:33,933::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d21fe0c-bc4f-440c-a2a2-0eca92fab3fd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692739', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053817', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:16:33,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d21fe0c-bc4f-440c-a2a2-0eca92fab3fd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:16:33,933::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:16:33,933::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:16:33,934::task::993::Storage.TaskManager.Task::(_decref) Task=`6d21fe0c-bc4f-440c-a2a2-0eca92fab3fd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:16:41,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:16:41,151::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715441 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:16:41,269::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:16:41,277::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640773 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:16:49,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d1a25f5-f5ff-41da-af0b-d13fddc9ec0a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:16:49,051::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:16:49,051::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640773', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715441', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:16:49,052::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d1a25f5-f5ff-41da-af0b-d13fddc9ec0a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640773', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715441', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:16:49,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d1a25f5-f5ff-41da-af0b-d13fddc9ec0a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:16:49,052::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:16:49,052::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:16:49,052::task::993::Storage.TaskManager.Task::(_decref) Task=`8d1a25f5-f5ff-41da-af0b-d13fddc9ec0a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:16:51,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:16:51,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000555248 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:16:51,278::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:16:51,287::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000496225 s, 8.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:17:01,168::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:17:01,177::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699018 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:17:01,289::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:17:01,298::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628325 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:17:04,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a777317-3a74-46e4-ae75-71fb20d83862`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:17:04,160::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:17:04,161::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628325', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699018', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:17:04,161::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a777317-3a74-46e4-ae75-71fb20d83862`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628325', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699018', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:17:04,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a777317-3a74-46e4-ae75-71fb20d83862`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:17:04,161::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:17:04,161::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:17:04,161::task::993::Storage.TaskManager.Task::(_decref) Task=`5a777317-3a74-46e4-ae75-71fb20d83862`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:17:11,180::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:17:11,188::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682021 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:17:11,299::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:17:11,307::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585198 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:17:19,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ce24a14-3160-47e0-a4f9-fb1abd5c217d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:17:19,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:17:19,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585198', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682021', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:17:19,270::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ce24a14-3160-47e0-a4f9-fb1abd5c217d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585198', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682021', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:17:19,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ce24a14-3160-47e0-a4f9-fb1abd5c217d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:17:19,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:17:19,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:17:19,271::task::993::Storage.TaskManager.Task::(_decref) Task=`4ce24a14-3160-47e0-a4f9-fb1abd5c217d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:17:21,191::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:17:21,200::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621724 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:17:21,309::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:17:21,318::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645359 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:17:31,204::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:17:31,212::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00053715 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:17:31,320::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:17:31,328::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00052574 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:17:34,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`4451feaa-2ad9-4b15-976f-904237a78c28`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:17:34,378::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:17:34,379::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052574', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053715', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:17:34,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`4451feaa-2ad9-4b15-976f-904237a78c28`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052574', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053715', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:17:34,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`4451feaa-2ad9-4b15-976f-904237a78c28`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:17:34,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:17:34,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:17:34,379::task::993::Storage.TaskManager.Task::(_decref) Task=`4451feaa-2ad9-4b15-976f-904237a78c28`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:17:41,215::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:17:41,224::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000778605 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:17:41,330::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:17:41,338::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694057 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:17:49,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`002a2970-66d6-490c-b74f-f1fae760c851`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:17:49,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:17:49,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694057', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778605', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:17:49,485::task::1191::Storage.TaskManager.Task::(prepare) Task=`002a2970-66d6-490c-b74f-f1fae760c851`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694057', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778605', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:17:49,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`002a2970-66d6-490c-b74f-f1fae760c851`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:17:49,485::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:17:49,486::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:17:49,486::task::993::Storage.TaskManager.Task::(_decref) Task=`002a2970-66d6-490c-b74f-f1fae760c851`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:17:51,227::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:17:51,235::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000522174 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:17:51,340::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:17:51,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000500908 s, 8.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:18:01,239::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:18:01,247::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600502 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:01,351::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:01,359::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000723456 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:18:04,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3f34bf8-7560-41fe-be57-45eec90970d9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:18:04,591::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:18:04,592::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723456', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600502', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:18:04,592::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3f34bf8-7560-41fe-be57-45eec90970d9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723456', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600502', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:18:04,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3f34bf8-7560-41fe-be57-45eec90970d9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:18:04,592::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:18:04,592::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:18:04,592::task::993::Storage.TaskManager.Task::(_decref) Task=`e3f34bf8-7560-41fe-be57-45eec90970d9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:18:11,251::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:18:11,260::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706593 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:11,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:11,369::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617272 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:18:19,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce02c830-85c9-4747-87ba-4698a2cc8aae`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:18:19,706::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:18:19,706::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617272', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706593', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:18:19,707::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce02c830-85c9-4747-87ba-4698a2cc8aae`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617272', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706593', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:18:19,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce02c830-85c9-4747-87ba-4698a2cc8aae`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:18:19,707::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:18:19,707::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:18:19,707::task::993::Storage.TaskManager.Task::(_decref) Task=`ce02c830-85c9-4747-87ba-4698a2cc8aae`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:18:21,263::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:18:21,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626434 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:21,371::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:21,380::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674129 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:18:31,275::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:18:31,284::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000535257 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:31,381::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:31,390::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544483 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:18:34,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`206f8c47-4106-4625-9da1-91e77b28846f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:18:34,852::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:18:34,852::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544483', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535257', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:18:34,852::task::1191::Storage.TaskManager.Task::(prepare) Task=`206f8c47-4106-4625-9da1-91e77b28846f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544483', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535257', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:18:34,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`206f8c47-4106-4625-9da1-91e77b28846f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:18:34,852::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:18:34,852::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:18:34,853::task::993::Storage.TaskManager.Task::(_decref) Task=`206f8c47-4106-4625-9da1-91e77b28846f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:18:41,287::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:18:41,296::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065081 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:41,392::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:41,400::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628161 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:18:49,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`d59265e2-da87-4324-b1cc-f03e4d0aaf6b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:18:49,966::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:18:49,966::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628161', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065081', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:18:49,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`d59265e2-da87-4324-b1cc-f03e4d0aaf6b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628161', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065081', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:18:49,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`d59265e2-da87-4324-b1cc-f03e4d0aaf6b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:18:49,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:18:49,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:18:49,967::task::993::Storage.TaskManager.Task::(_decref) Task=`d59265e2-da87-4324-b1cc-f03e4d0aaf6b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:18:51,299::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:18:51,299::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:18:51,300::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:18:51,308::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000615908 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:18:51,308::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000615908 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:18:51,308::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:18:51,309::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:18:51,309::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:18:51,309::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:18:51,309::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:18:51,310::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:18:51,310::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:18:51,310::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:18:51,310::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:51,402::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:18:51,402::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:18:51,403::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:51,412::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000661973 s, 3.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:51,412::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000661973 s, 3.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:18:51,412::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:18:51,412::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:18:51,413::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:18:51,413::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:18:51,558::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:18:51,559::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:18:51,560::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:18:51,561::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:18:51,563::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:18:51,565::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::DEBUG::2014-08-12 17:18:51,566::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 17:18:51,566::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:18:51,567::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:18:51,568::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:18:51,570::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:51,571::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:18:51,580::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:18:51,737::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:18:51,738::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:18:51,746::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528593 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:51,758::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:51,759::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:18:51,759::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:18:51,760::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:18:51,760::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:18:51,760::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:18:51,761::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:51,929::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:18:51,930::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:18:51,938::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595829 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:19:01,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:19:01,758::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608322 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:19:01,939::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:19:01,949::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800664 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:19:05,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`956cb388-725f-4d47-a827-555119d7386a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:19:05,078::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:19:05,078::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800664', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608322', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:19:05,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`956cb388-725f-4d47-a827-555119d7386a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800664', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608322', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:19:05,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`956cb388-725f-4d47-a827-555119d7386a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:19:05,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:19:05,079::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:19:05,079::task::993::Storage.TaskManager.Task::(_decref) Task=`956cb388-725f-4d47-a827-555119d7386a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:19:11,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:19:11,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0005531 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:19:11,950::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:19:11,958::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540045 s, 7.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:19:20,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cbc0f11-3472-4b43-a1de-3c6c74223995`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:19:20,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:19:20,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540045', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005531', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:19:20,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`8cbc0f11-3472-4b43-a1de-3c6c74223995`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540045', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005531', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:19:20,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cbc0f11-3472-4b43-a1de-3c6c74223995`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:19:20,198::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:19:20,198::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:19:20,199::task::993::Storage.TaskManager.Task::(_decref) Task=`8cbc0f11-3472-4b43-a1de-3c6c74223995`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:19:21,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:19:21,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710709 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:19:21,960::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:19:21,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000561168 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:19:31,785::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:19:31,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569567 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:19:31,970::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:19:31,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569686 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:19:35,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e092f51-fe82-40cc-a438-7b13d368f599`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:19:35,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:19:35,306::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569686', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569567', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:19:35,307::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e092f51-fe82-40cc-a438-7b13d368f599`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569686', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569567', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:19:35,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e092f51-fe82-40cc-a438-7b13d368f599`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:19:35,307::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:19:35,307::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:19:35,307::task::993::Storage.TaskManager.Task::(_decref) Task=`6e092f51-fe82-40cc-a438-7b13d368f599`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:19:41,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:19:41,807::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568579 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:19:41,980::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:19:41,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635367 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:19:50,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`250ff48d-f35a-4d86-9aae-9797223fc522`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:19:50,413::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:19:50,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635367', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568579', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:19:50,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`250ff48d-f35a-4d86-9aae-9797223fc522`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635367', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568579', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:19:50,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`250ff48d-f35a-4d86-9aae-9797223fc522`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:19:50,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:19:50,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:19:50,414::task::993::Storage.TaskManager.Task::(_decref) Task=`250ff48d-f35a-4d86-9aae-9797223fc522`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:19:51,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:19:51,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000464323 s, 8.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:19:51,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:19:51,999::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000460179 s, 8.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:20:01,841::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:20:01,850::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602987 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:20:02,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:20:02,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000835358 s, 4.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:20:05,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f7ea54f-bd28-4646-a4a7-00d4bcb59ac4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:20:05,526::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:20:05,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000835358', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602987', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:20:05,527::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f7ea54f-bd28-4646-a4a7-00d4bcb59ac4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000835358', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602987', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:20:05,527::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f7ea54f-bd28-4646-a4a7-00d4bcb59ac4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:20:05,527::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:20:05,527::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:20:05,527::task::993::Storage.TaskManager.Task::(_decref) Task=`5f7ea54f-bd28-4646-a4a7-00d4bcb59ac4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:20:11,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:20:11,868::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568169 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:20:12,011::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:20:12,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000511113 s, 8.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:20:20,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5497969-3d41-4d06-8e3d-c7359aa705d1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:20:20,695::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:20:20,695::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511113', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568169', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:20:20,695::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5497969-3d41-4d06-8e3d-c7359aa705d1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511113', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568169', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:20:20,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5497969-3d41-4d06-8e3d-c7359aa705d1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:20:20,696::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:20:20,696::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:20:20,696::task::993::Storage.TaskManager.Task::(_decref) Task=`e5497969-3d41-4d06-8e3d-c7359aa705d1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:20:21,872::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:20:21,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000530561 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:20:22,021::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:20:22,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000452348 s, 9.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:20:31,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:20:31,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000518247 s, 7.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:20:32,031::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:20:32,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072133 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:20:35,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`63511164-3c6d-4ba9-b1d2-b6dda98dac96`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:20:35,802::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:20:35,803::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072133', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518247', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:20:35,803::task::1191::Storage.TaskManager.Task::(prepare) Task=`63511164-3c6d-4ba9-b1d2-b6dda98dac96`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072133', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518247', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:20:35,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`63511164-3c6d-4ba9-b1d2-b6dda98dac96`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:20:35,803::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:20:35,803::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:20:35,803::task::993::Storage.TaskManager.Task::(_decref) Task=`63511164-3c6d-4ba9-b1d2-b6dda98dac96`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:20:41,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:20:41,917::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00588011 s, 697 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:20:42,041::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:20:42,049::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583702 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:20:50,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`c253f129-5e43-433b-85df-74b2165eafc8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:20:50,919::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:20:50,919::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583702', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00588011', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:20:50,919::task::1191::Storage.TaskManager.Task::(prepare) Task=`c253f129-5e43-433b-85df-74b2165eafc8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583702', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00588011', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:20:50,920::task::595::Storage.TaskManager.Task::(_updateState) Task=`c253f129-5e43-433b-85df-74b2165eafc8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:20:50,920::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:20:50,920::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:20:50,920::task::993::Storage.TaskManager.Task::(_decref) Task=`c253f129-5e43-433b-85df-74b2165eafc8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:20:51,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:20:51,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593593 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:20:52,051::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:20:52,060::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571877 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:21:01,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:21:01,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614323 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:21:02,062::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:21:02,072::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609087 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:21:06,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa324e8f-3187-49b9-b076-396887a21cc8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:21:06,029::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:21:06,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609087', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614323', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:21:06,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa324e8f-3187-49b9-b076-396887a21cc8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609087', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614323', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:21:06,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa324e8f-3187-49b9-b076-396887a21cc8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:21:06,030::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:21:06,030::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:21:06,030::task::993::Storage.TaskManager.Task::(_decref) Task=`aa324e8f-3187-49b9-b076-396887a21cc8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:21:11,944::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:21:11,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685962 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:21:12,073::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:21:12,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663181 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:21:21,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`f81833fe-8485-4e92-ba90-bd1aecf14b5b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:21:21,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:21:21,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663181', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685962', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:21:21,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`f81833fe-8485-4e92-ba90-bd1aecf14b5b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663181', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685962', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:21:21,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`f81833fe-8485-4e92-ba90-bd1aecf14b5b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:21:21,135::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:21:21,135::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:21:21,135::task::993::Storage.TaskManager.Task::(_decref) Task=`f81833fe-8485-4e92-ba90-bd1aecf14b5b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:21:21,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:21:21,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712609 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:21:22,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:21:22,092::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000523943 s, 7.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:21:31,968::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:21:31,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648335 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:21:32,094::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:21:32,103::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000745983 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:21:36,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b23c3d8-e24e-4318-abfc-7755de6ba739`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:21:36,241::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:21:36,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745983', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648335', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:21:36,242::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b23c3d8-e24e-4318-abfc-7755de6ba739`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745983', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648335', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:21:36,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b23c3d8-e24e-4318-abfc-7755de6ba739`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:21:36,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:21:36,242::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:21:36,242::task::993::Storage.TaskManager.Task::(_decref) Task=`8b23c3d8-e24e-4318-abfc-7755de6ba739`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:21:41,989::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:21:41,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729067 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:21:42,104::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:21:42,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662744 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:21:51,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0b16b00-5e6e-4376-b743-48f9f0fd7c84`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:21:51,351::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:21:51,351::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662744', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729067', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:21:51,351::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0b16b00-5e6e-4376-b743-48f9f0fd7c84`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662744', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729067', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:21:51,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0b16b00-5e6e-4376-b743-48f9f0fd7c84`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:21:51,352::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:21:51,352::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:21:51,352::task::993::Storage.TaskManager.Task::(_decref) Task=`e0b16b00-5e6e-4376-b743-48f9f0fd7c84`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:21:52,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:21:52,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552299 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:21:52,114::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:21:52,123::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000555901 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:22:02,012::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:22:02,020::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681161 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:22:02,125::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:22:02,133::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752287 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:22:06,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`80b264f8-d4a1-4821-be6f-8211101e868a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:22:06,454::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:22:06,454::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752287', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681161', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:22:06,454::task::1191::Storage.TaskManager.Task::(prepare) Task=`80b264f8-d4a1-4821-be6f-8211101e868a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752287', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681161', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:22:06,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`80b264f8-d4a1-4821-be6f-8211101e868a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:22:06,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:22:06,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:22:06,455::task::993::Storage.TaskManager.Task::(_decref) Task=`80b264f8-d4a1-4821-be6f-8211101e868a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:22:12,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:22:12,032::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684415 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:22:12,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:22:12,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000584802 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:22:21,557::task::595::Storage.TaskManager.Task::(_updateState) Task=`18398e05-70d8-4a3b-a57f-b91eae722c34`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:22:21,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:22:21,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584802', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684415', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:22:21,558::task::1191::Storage.TaskManager.Task::(prepare) Task=`18398e05-70d8-4a3b-a57f-b91eae722c34`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584802', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684415', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:22:21,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`18398e05-70d8-4a3b-a57f-b91eae722c34`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:22:21,559::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:22:21,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:22:21,559::task::993::Storage.TaskManager.Task::(_decref) Task=`18398e05-70d8-4a3b-a57f-b91eae722c34`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:22:22,036::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:22:22,044::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00052968 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:22:22,145::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:22:22,154::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554573 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:22:32,048::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:22:32,056::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000531658 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:22:32,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:22:32,164::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610665 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:22:36,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`54850739-cfce-49fe-9d9c-de3f24a09fd3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:22:36,669::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:22:36,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610665', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531658', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:22:36,670::task::1191::Storage.TaskManager.Task::(prepare) Task=`54850739-cfce-49fe-9d9c-de3f24a09fd3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610665', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531658', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:22:36,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`54850739-cfce-49fe-9d9c-de3f24a09fd3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:22:36,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:22:36,670::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:22:36,670::task::993::Storage.TaskManager.Task::(_decref) Task=`54850739-cfce-49fe-9d9c-de3f24a09fd3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:22:42,067::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:22:42,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644757 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:22:42,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:22:42,173::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059434 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:22:51,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`950315fe-32e2-486c-a6e0-f144e6e149b7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:22:51,777::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:22:51,777::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059434', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644757', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:22:51,777::task::1191::Storage.TaskManager.Task::(prepare) Task=`950315fe-32e2-486c-a6e0-f144e6e149b7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059434', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644757', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:22:51,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`950315fe-32e2-486c-a6e0-f144e6e149b7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:22:51,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:22:51,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:22:51,778::task::993::Storage.TaskManager.Task::(_decref) Task=`950315fe-32e2-486c-a6e0-f144e6e149b7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:22:52,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:22:52,092::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571175 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:22:52,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:22:52,184::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000511972 s, 8.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:23:02,096::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:23:02,103::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607744 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:02,195::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:02,203::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065826 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:23:06,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`65f2dac4-d019-4421-bdbf-82519646aab3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:23:06,961::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:23:06,962::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065826', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607744', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:23:06,962::task::1191::Storage.TaskManager.Task::(prepare) Task=`65f2dac4-d019-4421-bdbf-82519646aab3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065826', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607744', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:23:06,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`65f2dac4-d019-4421-bdbf-82519646aab3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:23:06,962::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:23:06,962::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:23:06,962::task::993::Storage.TaskManager.Task::(_decref) Task=`65f2dac4-d019-4421-bdbf-82519646aab3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:23:12,107::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:23:12,115::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007626 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:12,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:12,213::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597533 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:23:22,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`653c7906-071a-400b-92a9-43468f81272b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:23:22,075::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:23:22,076::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597533', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007626', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:23:22,076::task::1191::Storage.TaskManager.Task::(prepare) Task=`653c7906-071a-400b-92a9-43468f81272b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597533', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007626', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:23:22,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`653c7906-071a-400b-92a9-43468f81272b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:23:22,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:23:22,076::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:23:22,077::task::993::Storage.TaskManager.Task::(_decref) Task=`653c7906-071a-400b-92a9-43468f81272b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:23:22,118::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:23:22,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057859 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:22,215::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:22,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00050374 s, 8.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:23:32,131::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:23:32,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624602 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:32,225::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:32,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000778612 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:23:37,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e235b32-4b3d-4aec-9e2d-043e2c55a600`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:23:37,190::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:23:37,190::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778612', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624602', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:23:37,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e235b32-4b3d-4aec-9e2d-043e2c55a600`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000778612', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624602', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:23:37,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e235b32-4b3d-4aec-9e2d-043e2c55a600`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:23:37,191::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:23:37,191::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:23:37,191::task::993::Storage.TaskManager.Task::(_decref) Task=`7e235b32-4b3d-4aec-9e2d-043e2c55a600`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:23:42,142::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:23:42,150::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620349 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:42,235::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:42,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598382 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:23:52,153::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:23:52,154::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:23:52,154::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:23:52,163::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000511643 s, 4.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:23:52,163::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000511643 s, 4.0 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:23:52,164::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:23:52,164::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:23:52,164::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:23:52,164::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:23:52,165::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:23:52,165::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:23:52,165::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:23:52,165::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:23:52,166::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:52,245::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:23:52,246::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:23:52,246::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:52,255::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000624236 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:52,256::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000624236 s, 3.3 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:23:52,256::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:23:52,256::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:23:52,256::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:23:52,257::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-15::DEBUG::2014-08-12 17:23:52,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea369f34-e1ec-4745-a925-fca09e0a7ade`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:23:52,308::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:23:52,309::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598382', 'lastCheck': '10.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620349', 'lastCheck': '10.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:23:52,309::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea369f34-e1ec-4745-a925-fca09e0a7ade`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598382', 'lastCheck': '10.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620349', 'lastCheck': '10.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:23:52,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea369f34-e1ec-4745-a925-fca09e0a7ade`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:23:52,309::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:23:52,309::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:23:52,309::task::993::Storage.TaskManager.Task::(_decref) Task=`ea369f34-e1ec-4745-a925-fca09e0a7ade`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:23:52,406::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:23:52,407::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:23:52,409::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:23:52,409::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:23:52,413::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:23:52,417::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::DEBUG::2014-08-12 17:23:52,417::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 17:23:52,419::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:23:52,421::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:23:52,422::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:23:52,425::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:52,426::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:23:52,437::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:23:52,596::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:23:52,598::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:23:52,608::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000431144 s, 9.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:52,616::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:52,621::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:23:52,624::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:23:52,633::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:23:52,635::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:23:52,635::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:23:52,637::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:52,808::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:23:52,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:23:52,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569769 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:24:02,635::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:24:02,643::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606717 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:24:02,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:24:02,832::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000826978 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:24:07,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`dcacd806-5474-430a-891e-3439c21b005c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:24:07,421::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:24:07,421::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000826978', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606717', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:24:07,421::task::1191::Storage.TaskManager.Task::(prepare) Task=`dcacd806-5474-430a-891e-3439c21b005c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000826978', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606717', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:24:07,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`dcacd806-5474-430a-891e-3439c21b005c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:24:07,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:24:07,422::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:24:07,422::task::993::Storage.TaskManager.Task::(_decref) Task=`dcacd806-5474-430a-891e-3439c21b005c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:24:12,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:24:12,655::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00085231 s, 4.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:24:12,833::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:24:12,842::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581278 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:24:22,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`88850131-88c0-421f-8f85-5c0a54d8c7df`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:24:22,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:24:22,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581278', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00085231', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:24:22,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`88850131-88c0-421f-8f85-5c0a54d8c7df`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581278', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00085231', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:24:22,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`88850131-88c0-421f-8f85-5c0a54d8c7df`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:24:22,542::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:24:22,542::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:24:22,543::task::993::Storage.TaskManager.Task::(_decref) Task=`88850131-88c0-421f-8f85-5c0a54d8c7df`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:24:22,659::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:24:22,669::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000755989 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:24:22,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:24:22,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718272 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:24:32,681::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:24:32,690::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649463 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:24:32,857::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:24:32,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784825 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:24:37,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`64c2ef85-605e-4cfc-9529-e465ce4f8900`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:24:37,680::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:24:37,680::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784825', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649463', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:24:37,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`64c2ef85-605e-4cfc-9529-e465ce4f8900`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784825', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649463', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:24:37,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`64c2ef85-605e-4cfc-9529-e465ce4f8900`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:24:37,681::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:24:37,681::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:24:37,681::task::993::Storage.TaskManager.Task::(_decref) Task=`64c2ef85-605e-4cfc-9529-e465ce4f8900`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:24:42,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:24:42,702::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764362 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:24:42,867::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:24:42,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612999 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:24:52,708::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:24:52,718::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065567 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:24:52,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`12337fae-3814-4dd0-a8ca-e9415ca385da`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:24:52,796::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:24:52,797::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612999', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065567', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:24:52,797::task::1191::Storage.TaskManager.Task::(prepare) Task=`12337fae-3814-4dd0-a8ca-e9415ca385da`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612999', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065567', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:24:52,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`12337fae-3814-4dd0-a8ca-e9415ca385da`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:24:52,799::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:24:52,799::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:24:52,800::task::993::Storage.TaskManager.Task::(_decref) Task=`12337fae-3814-4dd0-a8ca-e9415ca385da`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 17:24:52,878::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:24:52,888::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562621 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:25:02,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:25:02,739::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620269 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:25:02,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:25:02,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067326 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:25:07,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`387d680f-a5b8-4795-bf18-b7f3996d8401`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:25:07,942::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:25:07,954::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067326', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620269', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:25:07,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`387d680f-a5b8-4795-bf18-b7f3996d8401`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067326', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620269', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:25:07,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`387d680f-a5b8-4795-bf18-b7f3996d8401`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:25:07,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:25:07,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:25:07,955::task::993::Storage.TaskManager.Task::(_decref) Task=`387d680f-a5b8-4795-bf18-b7f3996d8401`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:25:12,743::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:25:12,751::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780537 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:25:12,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:25:12,910::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595612 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:25:22,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:25:22,767::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615366 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:25:22,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:25:22,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622522 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:25:23,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`05757e5b-b1e8-4b74-85ae-404a7df56faa`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:25:23,066::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:25:23,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622522', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615366', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:25:23,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`05757e5b-b1e8-4b74-85ae-404a7df56faa`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622522', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615366', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:25:23,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`05757e5b-b1e8-4b74-85ae-404a7df56faa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:25:23,071::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:25:23,071::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:25:23,072::task::993::Storage.TaskManager.Task::(_decref) Task=`05757e5b-b1e8-4b74-85ae-404a7df56faa`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:25:32,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:25:32,788::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802931 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:25:32,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:25:32,934::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698508 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:25:38,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`31b9d109-1023-4545-a0a8-dc8b0edc20e9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:25:38,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:25:38,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698508', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802931', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:25:38,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`31b9d109-1023-4545-a0a8-dc8b0edc20e9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698508', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000802931', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:25:38,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`31b9d109-1023-4545-a0a8-dc8b0edc20e9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:25:38,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:25:38,209::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:25:38,209::task::993::Storage.TaskManager.Task::(_decref) Task=`31b9d109-1023-4545-a0a8-dc8b0edc20e9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:25:42,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:25:42,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625548 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:25:42,936::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:25:42,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0103362 s, 396 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:25:52,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:25:52,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669754 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:25:52,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:25:52,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063386 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:25:53,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f974e58-fb4b-498d-8e15-a08e682ed0c9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:25:53,326::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:25:53,327::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063386', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669754', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:25:53,328::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f974e58-fb4b-498d-8e15-a08e682ed0c9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063386', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669754', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:25:53,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f974e58-fb4b-498d-8e15-a08e682ed0c9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:25:53,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:25:53,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:25:53,331::task::993::Storage.TaskManager.Task::(_decref) Task=`8f974e58-fb4b-498d-8e15-a08e682ed0c9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:26:02,830::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:26:02,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630034 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:26:02,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:26:02,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750438 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:26:08,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee6f0f84-5c1e-4e4b-a1c1-d1c28bab2336`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:26:08,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:26:08,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750438', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630034', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:26:08,485::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee6f0f84-5c1e-4e4b-a1c1-d1c28bab2336`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750438', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630034', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:26:08,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee6f0f84-5c1e-4e4b-a1c1-d1c28bab2336`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:26:08,485::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:26:08,486::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:26:08,486::task::993::Storage.TaskManager.Task::(_decref) Task=`ee6f0f84-5c1e-4e4b-a1c1-d1c28bab2336`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:26:12,841::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:26:12,850::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714588 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:26:12,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:26:12,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590473 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:26:22,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:26:22,865::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000724358 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:26:22,991::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:26:23,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700523 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:26:23,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`f969d727-6682-45b7-92cd-1a82fa2a19a4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:26:23,592::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:26:23,592::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700523', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000724358', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:26:23,592::task::1191::Storage.TaskManager.Task::(prepare) Task=`f969d727-6682-45b7-92cd-1a82fa2a19a4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700523', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000724358', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:26:23,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`f969d727-6682-45b7-92cd-1a82fa2a19a4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:26:23,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:26:23,593::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:26:23,593::task::993::Storage.TaskManager.Task::(_decref) Task=`f969d727-6682-45b7-92cd-1a82fa2a19a4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:26:32,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:26:32,887::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000526194 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:26:33,003::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:26:33,012::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704482 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:26:38,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`01b3a6ef-c114-4a64-b156-cd40ee598fd5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:26:38,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:26:38,700::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704482', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526194', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:26:38,701::task::1191::Storage.TaskManager.Task::(prepare) Task=`01b3a6ef-c114-4a64-b156-cd40ee598fd5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704482', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526194', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:26:38,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`01b3a6ef-c114-4a64-b156-cd40ee598fd5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:26:38,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:26:38,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:26:38,701::task::993::Storage.TaskManager.Task::(_decref) Task=`01b3a6ef-c114-4a64-b156-cd40ee598fd5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:26:42,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:26:42,898::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622192 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:26:43,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:26:43,022::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608619 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:26:52,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:26:52,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592576 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:26:53,025::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:26:53,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000570538 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:26:53,801::task::595::Storage.TaskManager.Task::(_updateState) Task=`342adb8d-7899-4565-b958-e1ddf26d9f06`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:26:53,801::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:26:53,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570538', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592576', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:26:53,802::task::1191::Storage.TaskManager.Task::(prepare) Task=`342adb8d-7899-4565-b958-e1ddf26d9f06`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570538', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592576', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:26:53,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`342adb8d-7899-4565-b958-e1ddf26d9f06`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:26:53,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:26:53,802::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:26:53,803::task::993::Storage.TaskManager.Task::(_decref) Task=`342adb8d-7899-4565-b958-e1ddf26d9f06`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:27:02,928::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:27:02,936::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593045 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:27:03,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:27:03,045::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656503 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:27:08,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`4288b345-5c3b-4ae7-9843-a552df0299e1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:27:08,908::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:27:08,908::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656503', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593045', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:27:08,908::task::1191::Storage.TaskManager.Task::(prepare) Task=`4288b345-5c3b-4ae7-9843-a552df0299e1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656503', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593045', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:27:08,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`4288b345-5c3b-4ae7-9843-a552df0299e1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:27:08,909::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:27:08,909::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:27:08,909::task::993::Storage.TaskManager.Task::(_decref) Task=`4288b345-5c3b-4ae7-9843-a552df0299e1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:27:12,939::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:27:12,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641155 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:27:13,047::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:27:13,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615843 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:27:22,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:27:22,963::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000529643 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:27:23,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:27:23,068::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567087 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:27:24,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b858e64-7397-4b22-936b-25f678dba32f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:27:24,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:27:24,018::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567087', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529643', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:27:24,018::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b858e64-7397-4b22-936b-25f678dba32f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567087', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529643', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:27:24,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b858e64-7397-4b22-936b-25f678dba32f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:27:24,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:27:24,019::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:27:24,019::task::993::Storage.TaskManager.Task::(_decref) Task=`2b858e64-7397-4b22-936b-25f678dba32f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:27:32,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:27:32,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060861 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:27:33,071::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:27:33,080::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756293 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:27:39,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`a79c526d-d2c5-4ad6-8684-a45afdd4b2e8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:27:39,128::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:27:39,128::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756293', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060861', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:27:39,129::task::1191::Storage.TaskManager.Task::(prepare) Task=`a79c526d-d2c5-4ad6-8684-a45afdd4b2e8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756293', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060861', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:27:39,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`a79c526d-d2c5-4ad6-8684-a45afdd4b2e8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:27:39,129::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:27:39,129::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:27:39,129::task::993::Storage.TaskManager.Task::(_decref) Task=`a79c526d-d2c5-4ad6-8684-a45afdd4b2e8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:27:42,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:27:42,996::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623112 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:27:43,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:27:43,090::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610475 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:27:53,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:27:53,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618972 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:27:53,094::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:27:53,102::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580652 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:27:54,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3d955d0-6e87-4121-8168-46e5cb6e48f6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:27:54,239::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:27:54,240::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580652', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618972', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:27:54,240::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3d955d0-6e87-4121-8168-46e5cb6e48f6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580652', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618972', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:27:54,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3d955d0-6e87-4121-8168-46e5cb6e48f6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:27:54,240::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:27:54,240::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:27:54,241::task::993::Storage.TaskManager.Task::(_decref) Task=`e3d955d0-6e87-4121-8168-46e5cb6e48f6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:28:03,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:28:03,030::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592382 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:03,105::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:03,114::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665471 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:28:09,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc9409bc-6581-44c7-afeb-5f7c2457fdcd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:28:09,342::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:28:09,342::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665471', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592382', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:28:09,342::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc9409bc-6581-44c7-afeb-5f7c2457fdcd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665471', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592382', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:28:09,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc9409bc-6581-44c7-afeb-5f7c2457fdcd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:28:09,343::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:28:09,343::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:28:09,343::task::993::Storage.TaskManager.Task::(_decref) Task=`bc9409bc-6581-44c7-afeb-5f7c2457fdcd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:28:13,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:28:13,042::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750797 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:13,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:13,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588249 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:28:23,047::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:28:23,057::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625441 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:23,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:23,136::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614585 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:28:24,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`5afcf515-48e9-4cae-bed9-0f17459b4ce8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:28:24,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:28:24,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614585', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625441', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:28:24,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`5afcf515-48e9-4cae-bed9-0f17459b4ce8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614585', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625441', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:28:24,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`5afcf515-48e9-4cae-bed9-0f17459b4ce8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:28:24,459::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:28:24,459::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:28:24,459::task::993::Storage.TaskManager.Task::(_decref) Task=`5afcf515-48e9-4cae-bed9-0f17459b4ce8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:28:33,071::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:28:33,079::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000525283 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:33,140::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:33,148::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071941 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:28:39,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`61cee4a9-a10d-4e78-86e1-5c4f19258f7e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:28:39,583::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:28:39,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071941', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525283', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:28:39,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`61cee4a9-a10d-4e78-86e1-5c4f19258f7e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071941', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525283', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:28:39,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`61cee4a9-a10d-4e78-86e1-5c4f19258f7e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:28:39,584::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:28:39,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:28:39,585::task::993::Storage.TaskManager.Task::(_decref) Task=`61cee4a9-a10d-4e78-86e1-5c4f19258f7e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:28:43,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:28:43,091::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0005889 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:43,150::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:43,158::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079581 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:28:53,095::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:28:53,097::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:28:53,099::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:28:53,109::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000656994 s, 3.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:28:53,110::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000656994 s, 3.1 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:28:53,111::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:28:53,112::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:28:53,113::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:28:53,115::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:28:53,116::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:28:53,118::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:28:53,119::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:28:53,121::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:28:53,122::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:53,159::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:28:53,161::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:28:53,164::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:53,174::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000586008 s, 3.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:53,175::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000586008 s, 3.5 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:28:53,175::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:28:53,176::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:28:53,176::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:28:53,178::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:28:53,380::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:28:53,381::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:28:53,382::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:28:53,382::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:28:53,385::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:28:53,386::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:28:53,387::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::DEBUG::2014-08-12 17:28:53,388::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 17:28:53,388::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 17:28:53,390::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:53,390::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:28:53,400::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:28:53,400::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:28:53,558::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:28:53,558::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:28:53,567::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654678 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:53,581::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:53,581::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:28:53,581::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:28:53,582::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:28:53,583::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:28:53,583::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:28:53,583::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:53,750::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:28:53,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:28:53,758::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000520294 s, 7.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:28:54,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`e51abe2b-d3e4-441d-a691-eb8c76dff7ad`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:28:54,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:28:54,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520294', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654678', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:28:54,691::task::1191::Storage.TaskManager.Task::(prepare) Task=`e51abe2b-d3e4-441d-a691-eb8c76dff7ad`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520294', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654678', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:28:54,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`e51abe2b-d3e4-441d-a691-eb8c76dff7ad`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:28:54,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:28:54,692::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:28:54,692::task::993::Storage.TaskManager.Task::(_decref) Task=`e51abe2b-d3e4-441d-a691-eb8c76dff7ad`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:29:03,570::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:29:03,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602895 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:29:03,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:29:03,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590803 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:29:09,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f30c82d-31ee-4ad2-b84f-22c2968fba88`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:29:09,919::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:29:09,919::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590803', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602895', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:29:09,919::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f30c82d-31ee-4ad2-b84f-22c2968fba88`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590803', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602895', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:29:09,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f30c82d-31ee-4ad2-b84f-22c2968fba88`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:29:09,919::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:29:09,920::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:29:09,920::task::993::Storage.TaskManager.Task::(_decref) Task=`5f30c82d-31ee-4ad2-b84f-22c2968fba88`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:29:13,581::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:29:13,589::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058822 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:29:13,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:29:13,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657569 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:29:23,593::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:29:23,601::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628574 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:29:23,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:29:23,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000909349 s, 4.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:29:25,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b3c3e6a-db09-4148-ac69-779c013d7a35`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:29:25,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:29:25,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000909349', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628574', 'lastCheck': '1.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:29:25,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b3c3e6a-db09-4148-ac69-779c013d7a35`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000909349', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628574', 'lastCheck': '1.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:29:25,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b3c3e6a-db09-4148-ac69-779c013d7a35`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:29:25,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:29:25,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:29:25,134::task::993::Storage.TaskManager.Task::(_decref) Task=`5b3c3e6a-db09-4148-ac69-779c013d7a35`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:29:33,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:29:33,612::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000563562 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:29:33,790::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:29:33,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681008 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:29:40,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`fecf86ec-deb0-4c4d-8ce8-d9fa791b2a60`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:29:40,337::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:29:40,338::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681008', 'lastCheck': '6.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563562', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:29:40,338::task::1191::Storage.TaskManager.Task::(prepare) Task=`fecf86ec-deb0-4c4d-8ce8-d9fa791b2a60`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681008', 'lastCheck': '6.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563562', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:29:40,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`fecf86ec-deb0-4c4d-8ce8-d9fa791b2a60`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:29:40,338::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:29:40,338::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:29:40,338::task::993::Storage.TaskManager.Task::(_decref) Task=`fecf86ec-deb0-4c4d-8ce8-d9fa791b2a60`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:29:43,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:29:43,624::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622739 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:29:43,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:29:43,808::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058101 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:29:53,628::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:29:53,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006779 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:29:53,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:29:53,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000527841 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:29:55,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`5019ccb2-a4d7-4d45-be4a-597efc64925a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:29:55,569::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:29:55,569::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527841', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006779', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:29:55,570::task::1191::Storage.TaskManager.Task::(prepare) Task=`5019ccb2-a4d7-4d45-be4a-597efc64925a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527841', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006779', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:29:55,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`5019ccb2-a4d7-4d45-be4a-597efc64925a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:29:55,570::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:29:55,570::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:29:55,570::task::993::Storage.TaskManager.Task::(_decref) Task=`5019ccb2-a4d7-4d45-be4a-597efc64925a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:30:03,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:30:03,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596395 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:30:03,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:30:03,828::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000816116 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:30:10,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f5bfcc-2c20-43b3-a91f-dcfce6c68e7d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:30:10,693::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:30:10,693::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816116', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596395', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:30:10,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`58f5bfcc-2c20-43b3-a91f-dcfce6c68e7d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816116', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596395', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:30:10,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f5bfcc-2c20-43b3-a91f-dcfce6c68e7d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:30:10,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:30:10,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:30:10,694::task::993::Storage.TaskManager.Task::(_decref) Task=`58f5bfcc-2c20-43b3-a91f-dcfce6c68e7d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:30:13,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:30:13,660::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000539197 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:30:13,829::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:30:13,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554518 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:30:23,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:30:23,673::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679394 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:30:23,838::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:30:23,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624133 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:30:25,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f50db0c-6153-4557-ac29-4334844ce8db`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:30:25,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:30:25,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624133', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679394', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:30:25,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f50db0c-6153-4557-ac29-4334844ce8db`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624133', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679394', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:30:25,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f50db0c-6153-4557-ac29-4334844ce8db`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:30:25,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:30:25,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:30:25,818::task::993::Storage.TaskManager.Task::(_decref) Task=`8f50db0c-6153-4557-ac29-4334844ce8db`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:30:33,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:30:33,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000545218 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:30:33,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:30:33,856::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746831 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:30:40,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4b623f7-ee91-49eb-b5a6-8677b594b99d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:30:40,925::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:30:40,926::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746831', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545218', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:30:40,926::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4b623f7-ee91-49eb-b5a6-8677b594b99d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746831', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545218', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:30:40,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4b623f7-ee91-49eb-b5a6-8677b594b99d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:30:40,926::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:30:40,926::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:30:40,927::task::993::Storage.TaskManager.Task::(_decref) Task=`b4b623f7-ee91-49eb-b5a6-8677b594b99d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:30:43,688::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:30:43,697::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784675 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:30:43,858::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:30:43,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611374 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:30:53,701::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:30:53,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741499 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:30:53,867::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:30:53,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578975 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:30:56,033::task::595::Storage.TaskManager.Task::(_updateState) Task=`6377d5b4-21c5-4377-bab7-843ac4c79967`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:30:56,034::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:30:56,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578975', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741499', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:30:56,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`6377d5b4-21c5-4377-bab7-843ac4c79967`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578975', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741499', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:30:56,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`6377d5b4-21c5-4377-bab7-843ac4c79967`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:30:56,034::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:30:56,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:30:56,035::task::993::Storage.TaskManager.Task::(_decref) Task=`6377d5b4-21c5-4377-bab7-843ac4c79967`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:31:03,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:31:03,721::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652018 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:31:03,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:31:03,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612585 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:31:11,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`38993349-3015-455c-8b54-83f1c32a06e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:31:11,154::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:31:11,154::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612585', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652018', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:31:11,154::task::1191::Storage.TaskManager.Task::(prepare) Task=`38993349-3015-455c-8b54-83f1c32a06e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612585', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652018', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:31:11,154::task::595::Storage.TaskManager.Task::(_updateState) Task=`38993349-3015-455c-8b54-83f1c32a06e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:31:11,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:31:11,154::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:31:11,155::task::993::Storage.TaskManager.Task::(_decref) Task=`38993349-3015-455c-8b54-83f1c32a06e5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:31:13,724::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:31:13,733::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646657 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:31:13,886::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:31:13,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000534951 s, 7.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:31:23,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:31:23,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749956 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:31:23,896::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:31:23,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685404 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:31:26,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`369282ff-81d3-468e-b455-f70e3ebb03cb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:31:26,260::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:31:26,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685404', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749956', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:31:26,261::task::1191::Storage.TaskManager.Task::(prepare) Task=`369282ff-81d3-468e-b455-f70e3ebb03cb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685404', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749956', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:31:26,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`369282ff-81d3-468e-b455-f70e3ebb03cb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:31:26,261::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:31:26,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:31:26,261::task::993::Storage.TaskManager.Task::(_decref) Task=`369282ff-81d3-468e-b455-f70e3ebb03cb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:31:33,748::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:31:33,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662688 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:31:33,905::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:31:33,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621215 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:31:41,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`82c91e7f-e9da-4861-8f99-2c7177f5735a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:31:41,367::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:31:41,367::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621215', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662688', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:31:41,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`82c91e7f-e9da-4861-8f99-2c7177f5735a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621215', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662688', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:31:41,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`82c91e7f-e9da-4861-8f99-2c7177f5735a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:31:41,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:31:41,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:31:41,368::task::993::Storage.TaskManager.Task::(_decref) Task=`82c91e7f-e9da-4861-8f99-2c7177f5735a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:31:43,761::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:31:43,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726568 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:31:43,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:31:43,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062623 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:31:53,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:31:53,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708345 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:31:53,924::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:31:53,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636493 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:31:56,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd153b3b-8537-431c-a2bb-fdd03d69821b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:31:56,479::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:31:56,479::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636493', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708345', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:31:56,479::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd153b3b-8537-431c-a2bb-fdd03d69821b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636493', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708345', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:31:56,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd153b3b-8537-431c-a2bb-fdd03d69821b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:31:56,480::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:31:56,480::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:31:56,480::task::993::Storage.TaskManager.Task::(_decref) Task=`cd153b3b-8537-431c-a2bb-fdd03d69821b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:32:03,786::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:32:03,794::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671302 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:32:03,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:32:03,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713897 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:32:11,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`19fe2268-0c75-4979-916b-046831676c43`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:32:11,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:32:11,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713897', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671302', 'lastCheck': '7.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:32:11,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`19fe2268-0c75-4979-916b-046831676c43`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713897', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671302', 'lastCheck': '7.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:32:11,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`19fe2268-0c75-4979-916b-046831676c43`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:32:11,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:32:11,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:32:11,590::task::993::Storage.TaskManager.Task::(_decref) Task=`19fe2268-0c75-4979-916b-046831676c43`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:32:13,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:32:13,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544327 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:32:13,944::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:32:13,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061626 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:32:23,809::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:32:23,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000883075 s, 4.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:32:23,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:32:23,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594346 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:32:26,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fdd3809-27e2-47c4-8377-00f170acf8bc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:32:26,713::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:32:26,713::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594346', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000883075', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:32:26,713::task::1191::Storage.TaskManager.Task::(prepare) Task=`2fdd3809-27e2-47c4-8377-00f170acf8bc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594346', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000883075', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:32:26,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fdd3809-27e2-47c4-8377-00f170acf8bc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:32:26,714::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:32:26,714::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:32:26,714::task::993::Storage.TaskManager.Task::(_decref) Task=`2fdd3809-27e2-47c4-8377-00f170acf8bc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:32:33,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:32:33,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567892 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:32:33,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:32:33,971::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685336 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:32:41,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`e702bee6-bf08-48e4-9528-9f607ff73d57`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:32:41,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:32:41,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685336', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567892', 'lastCheck': '8.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:32:41,834::task::1191::Storage.TaskManager.Task::(prepare) Task=`e702bee6-bf08-48e4-9528-9f607ff73d57`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685336', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567892', 'lastCheck': '8.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:32:41,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`e702bee6-bf08-48e4-9528-9f607ff73d57`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:32:41,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:32:41,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:32:41,835::task::993::Storage.TaskManager.Task::(_decref) Task=`e702bee6-bf08-48e4-9528-9f607ff73d57`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:32:43,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:32:43,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687827 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:32:43,973::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:32:43,981::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706302 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:32:53,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:32:53,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582071 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:32:53,983::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:32:53,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587892 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:32:56,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bf7fd71-8796-4682-84c5-2a1d79410b28`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:32:56,948::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:32:56,948::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587892', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582071', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:32:56,948::task::1191::Storage.TaskManager.Task::(prepare) Task=`1bf7fd71-8796-4682-84c5-2a1d79410b28`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587892', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582071', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:32:56,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bf7fd71-8796-4682-84c5-2a1d79410b28`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:32:56,949::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:32:56,949::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:32:56,949::task::993::Storage.TaskManager.Task::(_decref) Task=`1bf7fd71-8796-4682-84c5-2a1d79410b28`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:33:03,858::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:33:03,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663133 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:03,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:04,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595417 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:33:12,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f207e4b-3fbd-48d3-b275-333823681dca`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:33:12,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:33:12,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595417', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663133', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:33:12,071::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f207e4b-3fbd-48d3-b275-333823681dca`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595417', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663133', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:33:12,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f207e4b-3fbd-48d3-b275-333823681dca`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:33:12,071::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:33:12,071::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:33:12,072::task::993::Storage.TaskManager.Task::(_decref) Task=`0f207e4b-3fbd-48d3-b275-333823681dca`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:33:13,870::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:33:13,878::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702174 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:14,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:14,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552528 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:33:23,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:33:23,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604636 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:24,012::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:24,020::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066064 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:33:27,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6a8f075-a099-47d2-b6b4-b628f7f24579`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:33:27,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:33:27,185::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066064', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604636', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:33:27,185::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6a8f075-a099-47d2-b6b4-b628f7f24579`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066064', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604636', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:33:27,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6a8f075-a099-47d2-b6b4-b628f7f24579`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:33:27,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:33:27,185::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:33:27,185::task::993::Storage.TaskManager.Task::(_decref) Task=`c6a8f075-a099-47d2-b6b4-b628f7f24579`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:33:33,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:33:33,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000555453 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:34,021::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:34,030::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069474 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:33:42,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`9aa809ee-64c8-46e9-85c8-2769d615ad2d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:33:42,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:33:42,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069474', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555453', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:33:42,354::task::1191::Storage.TaskManager.Task::(prepare) Task=`9aa809ee-64c8-46e9-85c8-2769d615ad2d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069474', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555453', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:33:42,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`9aa809ee-64c8-46e9-85c8-2769d615ad2d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:33:42,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:33:42,355::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:33:42,355::task::993::Storage.TaskManager.Task::(_decref) Task=`9aa809ee-64c8-46e9-85c8-2769d615ad2d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:33:43,918::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:33:43,928::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582899 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:44,032::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:44,039::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000518222 s, 7.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:33:53,932::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:33:53,933::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:33:53,933::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:33:53,941::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00071203 s, 2.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:33:53,942::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00071203 s, 2.9 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:33:53,942::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:33:53,942::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:33:53,942::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:33:53,943::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:33:53,943::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:33:53,943::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:33:53,943::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:33:53,944::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:33:53,944::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:54,041::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:33:54,041::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:33:54,042::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:54,051::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000625913 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:54,051::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000625913 s, 3.3 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:33:54,051::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:33:54,052::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:33:54,052::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:33:54,052::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:33:54,241::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:33:54,241::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:33:54,243::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:33:54,244::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:33:54,246::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:33:54,247::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:33:54,248::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::DEBUG::2014-08-12 17:33:54,248::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 17:33:54,249::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:33:54,250::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:33:54,251::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:54,260::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:33:54,260::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:33:54,421::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:33:54,421::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:33:54,429::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594635 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:54,445::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:54,445::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:33:54,445::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:33:54,446::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:33:54,446::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:33:54,447::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:33:54,447::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:54,615::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:33:54,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:33:54,624::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616011 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:33:57,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`72655ee6-e44c-49d3-9ac7-30e93cce2e09`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:33:57,469::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:33:57,469::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616011', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594635', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:33:57,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`72655ee6-e44c-49d3-9ac7-30e93cce2e09`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616011', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594635', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:33:57,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`72655ee6-e44c-49d3-9ac7-30e93cce2e09`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:33:57,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:33:57,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:33:57,470::task::993::Storage.TaskManager.Task::(_decref) Task=`72655ee6-e44c-49d3-9ac7-30e93cce2e09`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:34:04,433::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:34:04,473::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618174 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:34:04,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:34:04,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000773699 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:34:12,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8acdaf7-6675-4029-a3b8-c5fe62810b6f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:34:12,571::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:34:12,571::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773699', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618174', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:34:12,571::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8acdaf7-6675-4029-a3b8-c5fe62810b6f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773699', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618174', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:34:12,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8acdaf7-6675-4029-a3b8-c5fe62810b6f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:34:12,571::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:34:12,572::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:34:12,572::task::993::Storage.TaskManager.Task::(_decref) Task=`c8acdaf7-6675-4029-a3b8-c5fe62810b6f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:34:14,477::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:34:14,486::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611369 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:34:14,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:34:14,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599079 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:34:24,489::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:34:24,497::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727524 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:34:24,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:34:24,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678956 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:34:27,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`3382a7b6-ba9b-4806-ac74-acbc9015c11b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:34:27,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:34:27,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678956', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727524', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:34:27,675::task::1191::Storage.TaskManager.Task::(prepare) Task=`3382a7b6-ba9b-4806-ac74-acbc9015c11b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678956', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727524', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:34:27,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`3382a7b6-ba9b-4806-ac74-acbc9015c11b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:34:27,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:34:27,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:34:27,676::task::993::Storage.TaskManager.Task::(_decref) Task=`3382a7b6-ba9b-4806-ac74-acbc9015c11b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:34:34,514::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:34:34,523::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540248 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:34:34,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:34:34,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000761058 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:34:42,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`dacdccf2-ec3a-47c9-bcae-a7c6e5651848`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:34:42,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:34:42,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761058', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540248', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:34:42,785::task::1191::Storage.TaskManager.Task::(prepare) Task=`dacdccf2-ec3a-47c9-bcae-a7c6e5651848`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761058', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540248', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:34:42,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`dacdccf2-ec3a-47c9-bcae-a7c6e5651848`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:34:42,786::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:34:42,786::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:34:42,786::task::993::Storage.TaskManager.Task::(_decref) Task=`dacdccf2-ec3a-47c9-bcae-a7c6e5651848`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:34:44,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:34:44,535::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070419 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:34:44,665::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:34:44,673::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061464 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:34:54,539::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:34:54,547::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729983 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:34:54,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:34:54,682::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679016 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:34:57,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0c68a5e-a1e2-4193-b91f-768d4366a1ba`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:34:57,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:34:57,885::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679016', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729983', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:34:57,885::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0c68a5e-a1e2-4193-b91f-768d4366a1ba`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679016', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729983', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:34:57,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0c68a5e-a1e2-4193-b91f-768d4366a1ba`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:34:57,885::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:34:57,885::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:34:57,886::task::993::Storage.TaskManager.Task::(_decref) Task=`b0c68a5e-a1e2-4193-b91f-768d4366a1ba`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:35:04,550::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:35:04,558::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000531722 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:35:04,683::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:35:04,692::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00052805 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:35:12,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`58c565cf-b52e-4ead-858b-d45ddf9e5d42`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:35:12,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:35:12,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052805', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531722', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:35:12,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`58c565cf-b52e-4ead-858b-d45ddf9e5d42`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052805', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531722', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:35:12,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`58c565cf-b52e-4ead-858b-d45ddf9e5d42`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:35:12,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:35:12,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:35:12,988::task::993::Storage.TaskManager.Task::(_decref) Task=`58c565cf-b52e-4ead-858b-d45ddf9e5d42`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:35:14,562::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:35:14,572::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654283 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:35:14,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:35:14,702::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068664 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:35:24,575::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:35:24,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631977 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:35:24,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:35:24,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705328 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:35:28,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`90c5f905-a7d6-4476-a191-5c75b3b3ffcd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:35:28,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:35:28,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705328', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631977', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:35:28,099::task::1191::Storage.TaskManager.Task::(prepare) Task=`90c5f905-a7d6-4476-a191-5c75b3b3ffcd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705328', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631977', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:35:28,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`90c5f905-a7d6-4476-a191-5c75b3b3ffcd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:35:28,100::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:35:28,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:35:28,100::task::993::Storage.TaskManager.Task::(_decref) Task=`90c5f905-a7d6-4476-a191-5c75b3b3ffcd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:35:34,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:35:34,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000524133 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:35:34,712::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:35:34,720::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658025 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:35:43,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7ae49e0-f9c3-4b78-abfe-476f68486e10`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:35:43,204::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:35:43,204::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658025', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524133', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:35:43,205::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7ae49e0-f9c3-4b78-abfe-476f68486e10`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658025', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524133', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:35:43,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7ae49e0-f9c3-4b78-abfe-476f68486e10`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:35:43,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:35:43,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:35:43,205::task::993::Storage.TaskManager.Task::(_decref) Task=`a7ae49e0-f9c3-4b78-abfe-476f68486e10`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:35:44,598::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:35:44,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704506 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:35:44,722::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:35:44,730::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583547 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:35:54,610::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:35:54,619::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710549 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:35:54,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:35:54,739::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635521 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:35:58,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7d3bdec-b57c-4647-8744-6b13be3c5cf2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:35:58,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:35:58,309::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635521', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710549', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:35:58,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7d3bdec-b57c-4647-8744-6b13be3c5cf2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635521', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710549', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:35:58,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7d3bdec-b57c-4647-8744-6b13be3c5cf2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:35:58,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:35:58,310::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:35:58,310::task::993::Storage.TaskManager.Task::(_decref) Task=`c7d3bdec-b57c-4647-8744-6b13be3c5cf2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:36:04,622::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:36:04,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000561055 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:36:04,740::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:36:04,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711081 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:36:13,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`66f9b81e-816c-424f-bec9-029647731177`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:36:13,418::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:36:13,418::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711081', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561055', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:36:13,419::task::1191::Storage.TaskManager.Task::(prepare) Task=`66f9b81e-816c-424f-bec9-029647731177`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711081', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561055', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:36:13,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`66f9b81e-816c-424f-bec9-029647731177`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:36:13,419::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:36:13,419::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:36:13,419::task::993::Storage.TaskManager.Task::(_decref) Task=`66f9b81e-816c-424f-bec9-029647731177`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:36:14,633::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:36:14,642::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728764 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:36:14,751::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:36:14,759::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00053841 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:36:24,645::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:36:24,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000811048 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:36:24,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:36:24,767::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627886 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:36:28,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`472f9c90-00c9-420a-867b-1235083f2a1f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:36:28,543::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:36:28,543::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627886', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811048', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:36:28,543::task::1191::Storage.TaskManager.Task::(prepare) Task=`472f9c90-00c9-420a-867b-1235083f2a1f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627886', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811048', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:36:28,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`472f9c90-00c9-420a-867b-1235083f2a1f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:36:28,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:36:28,544::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:36:28,544::task::993::Storage.TaskManager.Task::(_decref) Task=`472f9c90-00c9-420a-867b-1235083f2a1f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:36:34,657::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:36:34,665::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610675 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:36:34,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:36:34,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000744101 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:36:43,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`f64349c3-0c2d-4fa8-aa19-a21bec9f0b30`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:36:43,646::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:36:43,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744101', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610675', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:36:43,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`f64349c3-0c2d-4fa8-aa19-a21bec9f0b30`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744101', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610675', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:36:43,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`f64349c3-0c2d-4fa8-aa19-a21bec9f0b30`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:36:43,647::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:36:43,647::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:36:43,647::task::993::Storage.TaskManager.Task::(_decref) Task=`f64349c3-0c2d-4fa8-aa19-a21bec9f0b30`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:36:44,668::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:36:44,677::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637679 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:36:44,779::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:36:44,787::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638768 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:36:54,680::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:36:54,689::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748315 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:36:54,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:36:54,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640918 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:36:58,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`8757c9d4-5aec-46b6-8b47-c57493943c70`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:36:58,752::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:36:58,752::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640918', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748315', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:36:58,752::task::1191::Storage.TaskManager.Task::(prepare) Task=`8757c9d4-5aec-46b6-8b47-c57493943c70`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640918', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748315', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:36:58,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`8757c9d4-5aec-46b6-8b47-c57493943c70`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:36:58,753::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:36:58,753::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:36:58,753::task::993::Storage.TaskManager.Task::(_decref) Task=`8757c9d4-5aec-46b6-8b47-c57493943c70`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:37:04,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:37:04,701::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596514 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:37:04,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:37:04,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702526 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:37:13,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`52645a16-1d92-4fe1-b1fb-b8e16c262355`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:37:13,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:37:13,867::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702526', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596514', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:37:13,867::task::1191::Storage.TaskManager.Task::(prepare) Task=`52645a16-1d92-4fe1-b1fb-b8e16c262355`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702526', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596514', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:37:13,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`52645a16-1d92-4fe1-b1fb-b8e16c262355`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:37:13,868::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:37:13,868::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:37:13,868::task::993::Storage.TaskManager.Task::(_decref) Task=`52645a16-1d92-4fe1-b1fb-b8e16c262355`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:37:14,705::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:37:14,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701645 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:37:14,808::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:37:14,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533631 s, 7.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:37:24,716::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:37:24,725::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709902 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:37:24,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:37:24,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640384 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:37:28,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd51deab-cbb3-4d83-bae0-27c332d2c6a7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:37:28,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:37:28,972::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640384', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709902', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:37:28,972::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd51deab-cbb3-4d83-bae0-27c332d2c6a7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640384', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709902', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:37:28,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd51deab-cbb3-4d83-bae0-27c332d2c6a7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:37:28,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:37:28,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:37:28,973::task::993::Storage.TaskManager.Task::(_decref) Task=`bd51deab-cbb3-4d83-bae0-27c332d2c6a7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:37:34,728::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:37:34,736::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533411 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:37:34,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:37:34,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710448 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:37:44,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a854e72-0acf-403f-833a-7150941d21bb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:37:44,091::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:37:44,092::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710448', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533411', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:37:44,092::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a854e72-0acf-403f-833a-7150941d21bb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710448', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533411', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:37:44,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a854e72-0acf-403f-833a-7150941d21bb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:37:44,092::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:37:44,092::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:37:44,092::task::993::Storage.TaskManager.Task::(_decref) Task=`5a854e72-0acf-403f-833a-7150941d21bb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:37:44,740::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:37:44,748::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650361 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:37:44,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:37:44,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000547271 s, 7.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:37:54,751::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:37:54,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624281 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:37:54,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:37:54,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000545349 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:37:59,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf966bef-fc38-455e-8a1b-3a5d3bfc2614`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:37:59,202::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:37:59,202::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545349', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624281', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:37:59,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf966bef-fc38-455e-8a1b-3a5d3bfc2614`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545349', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624281', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:37:59,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf966bef-fc38-455e-8a1b-3a5d3bfc2614`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:37:59,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:37:59,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:37:59,203::task::993::Storage.TaskManager.Task::(_decref) Task=`cf966bef-fc38-455e-8a1b-3a5d3bfc2614`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:38:04,763::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:38:04,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562124 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:04,856::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:04,865::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000809246 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:38:14,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fcae42a-a862-4bef-ac74-021cf2a9212e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:38:14,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:38:14,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809246', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562124', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:38:14,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`3fcae42a-a862-4bef-ac74-021cf2a9212e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809246', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562124', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:38:14,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fcae42a-a862-4bef-ac74-021cf2a9212e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:38:14,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:38:14,313::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:38:14,313::task::993::Storage.TaskManager.Task::(_decref) Task=`3fcae42a-a862-4bef-ac74-021cf2a9212e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:38:14,775::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:38:14,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659801 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:14,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:14,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601435 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:38:24,786::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:38:24,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659666 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:24,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:24,883::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638738 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:38:29,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`07b06f19-bba8-45af-ad0d-5f352e20decb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:38:29,413::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:38:29,413::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638738', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659666', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:38:29,413::task::1191::Storage.TaskManager.Task::(prepare) Task=`07b06f19-bba8-45af-ad0d-5f352e20decb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638738', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659666', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:38:29,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`07b06f19-bba8-45af-ad0d-5f352e20decb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:38:29,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:38:29,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:38:29,414::task::993::Storage.TaskManager.Task::(_decref) Task=`07b06f19-bba8-45af-ad0d-5f352e20decb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:38:34,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:38:34,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628146 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:34,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:34,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693111 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:38:44,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`445fc983-ffb0-41cc-827e-b1d012fb0d7b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:38:44,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:38:44,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693111', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628146', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:38:44,517::task::1191::Storage.TaskManager.Task::(prepare) Task=`445fc983-ffb0-41cc-827e-b1d012fb0d7b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693111', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628146', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:38:44,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`445fc983-ffb0-41cc-827e-b1d012fb0d7b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:38:44,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:38:44,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:38:44,518::task::993::Storage.TaskManager.Task::(_decref) Task=`445fc983-ffb0-41cc-827e-b1d012fb0d7b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:38:44,809::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:38:44,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619668 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:44,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:44,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675623 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:38:54,821::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:38:54,821::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:38:54,822::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:38:54,830::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000607847 s, 3.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:38:54,830::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000607847 s, 3.4 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:38:54,830::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:38:54,830::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:38:54,831::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:38:54,831::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:38:54,831::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:38:54,831::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:38:54,832::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:38:54,832::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:38:54,832::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:54,905::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:38:54,906::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:38:54,906::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:54,917::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000621753 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:54,917::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000621753 s, 3.3 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:38:54,917::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:38:54,917::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:38:54,918::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:38:54,918::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:38:55,093::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:38:55,093::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:38:55,094::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:38:55,096::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:38:55,098::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:38:55,098::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:38:55,099::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:38:55,100::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:38:55,101::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:38:55,102::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:55,111::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:38:55,111::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:38:55,112::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:38:55,271::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:38:55,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:38:55,281::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000532873 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:55,292::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:55,292::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:38:55,292::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:38:55,293::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:38:55,293::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:38:55,294::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:38:55,294::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:55,462::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:38:55,462::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:38:55,471::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642215 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:38:59,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`b15df56c-1476-4271-9cb9-448d3a6dba8c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:38:59,631::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:38:59,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642215', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532873', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:38:59,632::task::1191::Storage.TaskManager.Task::(prepare) Task=`b15df56c-1476-4271-9cb9-448d3a6dba8c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642215', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532873', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:38:59,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`b15df56c-1476-4271-9cb9-448d3a6dba8c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:38:59,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:38:59,632::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:38:59,632::task::993::Storage.TaskManager.Task::(_decref) Task=`b15df56c-1476-4271-9cb9-448d3a6dba8c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:39:05,285::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:39:05,293::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601738 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:39:05,472::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:39:05,480::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730693 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:39:14,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`e549e28b-9291-4210-a666-e11f99560a0a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:39:14,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:39:14,734::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730693', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601738', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:39:14,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`e549e28b-9291-4210-a666-e11f99560a0a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730693', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601738', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:39:14,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`e549e28b-9291-4210-a666-e11f99560a0a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:39:14,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:39:14,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:39:14,735::task::993::Storage.TaskManager.Task::(_decref) Task=`e549e28b-9291-4210-a666-e11f99560a0a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:39:15,296::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:39:15,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637994 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:39:15,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:39:15,493::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.003038 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:39:25,308::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:39:25,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722651 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:39:25,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:39:25,502::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759544 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:39:29,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b08054f-fa0b-4bcd-8fe7-2088ec1a127d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:39:29,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:39:29,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759544', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722651', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:39:29,844::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b08054f-fa0b-4bcd-8fe7-2088ec1a127d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759544', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722651', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:39:29,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b08054f-fa0b-4bcd-8fe7-2088ec1a127d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:39:29,845::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:39:29,845::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:39:29,845::task::993::Storage.TaskManager.Task::(_decref) Task=`8b08054f-fa0b-4bcd-8fe7-2088ec1a127d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:39:35,320::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:39:35,328::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615391 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:39:35,503::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:39:35,511::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704136 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:39:44,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d2d8871-bf5d-490d-bc4f-74a86db356a5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:39:44,946::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:39:44,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704136', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615391', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:39:44,947::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d2d8871-bf5d-490d-bc4f-74a86db356a5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704136', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615391', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:39:44,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d2d8871-bf5d-490d-bc4f-74a86db356a5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:39:44,947::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:39:44,947::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:39:44,948::task::993::Storage.TaskManager.Task::(_decref) Task=`5d2d8871-bf5d-490d-bc4f-74a86db356a5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:39:45,332::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:39:45,341::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632767 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:39:45,513::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:39:45,520::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610954 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:39:55,344::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:39:55,353::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000833285 s, 4.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:39:55,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:39:55,529::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708405 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:40:00,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`7183b220-3877-4cd2-9731-861b14b9b5dd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:40:00,053::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:40:00,053::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708405', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833285', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:40:00,054::task::1191::Storage.TaskManager.Task::(prepare) Task=`7183b220-3877-4cd2-9731-861b14b9b5dd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708405', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833285', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:40:00,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`7183b220-3877-4cd2-9731-861b14b9b5dd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:40:00,054::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:40:00,054::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:40:00,054::task::993::Storage.TaskManager.Task::(_decref) Task=`7183b220-3877-4cd2-9731-861b14b9b5dd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:40:05,357::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:40:05,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631747 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:40:05,531::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:40:05,540::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000801726 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:40:15,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae8ec13b-de47-4549-bc0a-d167d4343fa9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:40:15,167::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:40:15,168::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000801726', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631747', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:40:15,168::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae8ec13b-de47-4549-bc0a-d167d4343fa9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000801726', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631747', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:40:15,168::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae8ec13b-de47-4549-bc0a-d167d4343fa9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:40:15,168::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:40:15,168::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:40:15,168::task::993::Storage.TaskManager.Task::(_decref) Task=`ae8ec13b-de47-4549-bc0a-d167d4343fa9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:40:15,368::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:40:15,377::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655364 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:40:15,541::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:40:15,549::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596152 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:40:25,380::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:40:25,389::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701081 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:40:25,551::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:40:25,558::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000769739 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:40:30,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7baaa16-150a-4808-a77c-41f01f13ce81`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:40:30,283::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:40:30,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769739', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701081', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:40:30,284::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7baaa16-150a-4808-a77c-41f01f13ce81`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769739', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701081', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:40:30,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7baaa16-150a-4808-a77c-41f01f13ce81`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:40:30,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:40:30,284::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:40:30,284::task::993::Storage.TaskManager.Task::(_decref) Task=`f7baaa16-150a-4808-a77c-41f01f13ce81`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:40:35,392::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:40:35,400::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000560449 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:40:35,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:40:35,568::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609359 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:40:45,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`d57bfabb-ffd0-4ae5-961b-6fc9787cd689`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:40:45,387::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:40:45,388::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609359', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560449', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:40:45,388::task::1191::Storage.TaskManager.Task::(prepare) Task=`d57bfabb-ffd0-4ae5-961b-6fc9787cd689`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609359', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560449', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:40:45,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`d57bfabb-ffd0-4ae5-961b-6fc9787cd689`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:40:45,388::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:40:45,388::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:40:45,388::task::993::Storage.TaskManager.Task::(_decref) Task=`d57bfabb-ffd0-4ae5-961b-6fc9787cd689`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:40:45,404::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:40:45,414::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627664 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:40:45,570::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:40:45,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000776672 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:40:55,422::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:40:55,431::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706767 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:40:55,579::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:40:55,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068508 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:41:00,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4133784-7ba4-4e05-8ff1-89842cd8ca78`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:41:00,505::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:41:00,523::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068508', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706767', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:41:00,524::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4133784-7ba4-4e05-8ff1-89842cd8ca78`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068508', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706767', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:41:00,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4133784-7ba4-4e05-8ff1-89842cd8ca78`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:41:00,524::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:41:00,524::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:41:00,524::task::993::Storage.TaskManager.Task::(_decref) Task=`c4133784-7ba4-4e05-8ff1-89842cd8ca78`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:41:05,434::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:41:05,443::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710682 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:41:05,588::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:41:05,596::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665202 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:41:15,446::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:41:15,454::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682943 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:41:15,608::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:41:15,616::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548494 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:41:15,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`1051ba5f-c508-44db-a4e7-164375f35e59`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:41:15,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:41:15,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548494', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682943', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:41:15,631::task::1191::Storage.TaskManager.Task::(prepare) Task=`1051ba5f-c508-44db-a4e7-164375f35e59`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548494', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682943', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:41:15,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`1051ba5f-c508-44db-a4e7-164375f35e59`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:41:15,631::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:41:15,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:41:15,632::task::993::Storage.TaskManager.Task::(_decref) Task=`1051ba5f-c508-44db-a4e7-164375f35e59`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:41:25,458::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:41:25,466::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623438 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:41:25,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:41:25,625::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690577 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:41:30,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`d872d7fb-6483-4d36-813f-68652e5000b3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:41:30,737::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:41:30,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690577', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623438', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:41:30,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`d872d7fb-6483-4d36-813f-68652e5000b3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690577', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623438', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:41:30,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`d872d7fb-6483-4d36-813f-68652e5000b3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:41:30,738::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:41:30,738::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:41:30,738::task::993::Storage.TaskManager.Task::(_decref) Task=`d872d7fb-6483-4d36-813f-68652e5000b3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:41:35,469::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:41:35,477::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000527912 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:41:35,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:41:35,635::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688612 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:41:45,481::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:41:45,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663016 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:41:45,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:41:45,645::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657471 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:41:45,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`03ed28ab-7c7a-4c31-8a00-8b87d5f81e6e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:41:45,845::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:41:45,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657471', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663016', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:41:45,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`03ed28ab-7c7a-4c31-8a00-8b87d5f81e6e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657471', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663016', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:41:45,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`03ed28ab-7c7a-4c31-8a00-8b87d5f81e6e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:41:45,846::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:41:45,846::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:41:45,846::task::993::Storage.TaskManager.Task::(_decref) Task=`03ed28ab-7c7a-4c31-8a00-8b87d5f81e6e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:41:55,493::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:41:55,502::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742774 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:41:55,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:41:55,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650963 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:42:00,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b3ec155-07c2-47d2-ac42-81b29172e077`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:42:00,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:42:00,960::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650963', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742774', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:42:00,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b3ec155-07c2-47d2-ac42-81b29172e077`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650963', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742774', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:42:00,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b3ec155-07c2-47d2-ac42-81b29172e077`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:42:00,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:42:00,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:42:00,961::task::993::Storage.TaskManager.Task::(_decref) Task=`6b3ec155-07c2-47d2-ac42-81b29172e077`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:42:05,505::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:42:05,513::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591318 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:42:05,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:42:05,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000561222 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:42:15,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:42:15,534::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702531 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:42:15,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:42:15,674::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598548 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:42:16,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`26dd90ed-73c8-4cfa-8f8e-852b67cb54fd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:42:16,068::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:42:16,069::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598548', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702531', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:42:16,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`26dd90ed-73c8-4cfa-8f8e-852b67cb54fd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598548', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702531', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:42:16,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`26dd90ed-73c8-4cfa-8f8e-852b67cb54fd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:42:16,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:42:16,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:42:16,069::task::993::Storage.TaskManager.Task::(_decref) Task=`26dd90ed-73c8-4cfa-8f8e-852b67cb54fd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:42:25,538::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:42:25,546::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735514 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:42:25,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:42:25,683::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596851 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:42:31,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`13f6ec21-42a8-4825-922b-876fe5634b88`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:42:31,177::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:42:31,178::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596851', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735514', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:42:31,178::task::1191::Storage.TaskManager.Task::(prepare) Task=`13f6ec21-42a8-4825-922b-876fe5634b88`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596851', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735514', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:42:31,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`13f6ec21-42a8-4825-922b-876fe5634b88`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:42:31,178::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:42:31,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:42:31,178::task::993::Storage.TaskManager.Task::(_decref) Task=`13f6ec21-42a8-4825-922b-876fe5634b88`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:42:35,550::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:42:35,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000921401 s, 4.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:42:35,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:42:35,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751601 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:42:45,571::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:42:45,579::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072276 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:42:45,694::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:42:45,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685203 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:42:46,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`64e1a33c-5d3f-4199-b3af-b4ed85386b48`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:42:46,299::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:42:46,299::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685203', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072276', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:42:46,300::task::1191::Storage.TaskManager.Task::(prepare) Task=`64e1a33c-5d3f-4199-b3af-b4ed85386b48`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685203', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072276', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:42:46,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`64e1a33c-5d3f-4199-b3af-b4ed85386b48`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:42:46,300::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:42:46,300::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:42:46,300::task::993::Storage.TaskManager.Task::(_decref) Task=`64e1a33c-5d3f-4199-b3af-b4ed85386b48`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:42:55,583::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:42:55,591::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702411 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:42:55,704::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:42:55,711::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062324 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:43:01,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`fee5e372-8f1f-4dcb-a6dc-29f3ae8abc5b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:43:01,416::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:43:01,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062324', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702411', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:43:01,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`fee5e372-8f1f-4dcb-a6dc-29f3ae8abc5b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062324', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702411', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:43:01,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`fee5e372-8f1f-4dcb-a6dc-29f3ae8abc5b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:43:01,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:43:01,417::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:43:01,418::task::993::Storage.TaskManager.Task::(_decref) Task=`fee5e372-8f1f-4dcb-a6dc-29f3ae8abc5b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:43:05,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:43:05,603::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604232 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:05,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:05,722::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702793 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:43:15,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:43:15,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617011 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:15,723::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:15,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579428 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:43:16,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`847bd82b-d403-47ab-a10d-c5af4b09dc84`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:43:16,535::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:43:16,536::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579428', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617011', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:43:16,536::task::1191::Storage.TaskManager.Task::(prepare) Task=`847bd82b-d403-47ab-a10d-c5af4b09dc84`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579428', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617011', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:43:16,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`847bd82b-d403-47ab-a10d-c5af4b09dc84`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:43:16,536::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:43:16,536::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:43:16,536::task::993::Storage.TaskManager.Task::(_decref) Task=`847bd82b-d403-47ab-a10d-c5af4b09dc84`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:43:25,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:43:25,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669633 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:25,733::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:25,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684797 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:43:31,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`56cf5c2f-7d39-47f0-8ba9-6f2b23f57242`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:43:31,651::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:43:31,651::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684797', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669633', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:43:31,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`56cf5c2f-7d39-47f0-8ba9-6f2b23f57242`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684797', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669633', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:43:31,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`56cf5c2f-7d39-47f0-8ba9-6f2b23f57242`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:43:31,652::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:43:31,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:43:31,652::task::993::Storage.TaskManager.Task::(_decref) Task=`56cf5c2f-7d39-47f0-8ba9-6f2b23f57242`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:43:35,641::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:43:35,649::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067037 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:35,743::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:35,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749835 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:43:45,662::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:43:45,671::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114336 s, 3.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:45,753::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:45,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731981 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:43:46,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`9482c857-c8c8-4af1-bb22-baedc40168af`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:43:46,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:43:46,794::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731981', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114336', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:43:46,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`9482c857-c8c8-4af1-bb22-baedc40168af`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731981', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114336', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:43:46,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`9482c857-c8c8-4af1-bb22-baedc40168af`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:43:46,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:43:46,795::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:43:46,795::task::993::Storage.TaskManager.Task::(_decref) Task=`9482c857-c8c8-4af1-bb22-baedc40168af`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:43:55,674::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:43:55,675::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:43:55,675::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:43:55,684::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000733851 s, 2.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:43:55,684::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000733851 s, 2.8 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:43:55,684::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:43:55,684::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:43:55,684::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:43:55,685::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:43:55,685::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:43:55,685::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:43:55,685::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:43:55,686::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:43:55,686::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:55,763::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:43:55,764::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:43:55,764::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:55,773::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000597154 s, 3.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:55,774::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000597154 s, 3.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:43:55,774::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:43:55,774::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:43:55,774::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:43:55,775::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:43:55,954::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:43:55,954::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:43:55,955::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:43:55,956::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:43:55,958::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:43:55,959::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 17:43:55,960::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:43:55,961::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:43:55,961::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:43:55,961::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:43:55,963::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:55,964::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:43:55,972::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:43:56,136::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:43:56,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:43:56,146::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101873 s, 4.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:56,160::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:56,160::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:43:56,161::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:43:56,161::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:43:56,162::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:43:56,162::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:43:56,162::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:56,329::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:43:56,330::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:43:56,338::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000518587 s, 7.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:44:01,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cdf7bd0-6774-485f-b14b-d2bb370e1378`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:44:01,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:44:01,906::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518587', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101873', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:44:01,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`9cdf7bd0-6774-485f-b14b-d2bb370e1378`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518587', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101873', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:44:01,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cdf7bd0-6774-485f-b14b-d2bb370e1378`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:44:01,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:44:01,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:44:01,907::task::993::Storage.TaskManager.Task::(_decref) Task=`9cdf7bd0-6774-485f-b14b-d2bb370e1378`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:44:06,150::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:44:06,158::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636921 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:44:06,340::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:44:06,348::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774574 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:44:16,161::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:44:16,170::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000573784 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:44:16,350::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:44:16,357::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000512467 s, 8.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:44:17,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc06b43e-f2d4-48eb-be74-06e825cd7b95`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:44:17,027::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:44:17,027::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512467', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573784', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:44:17,027::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc06b43e-f2d4-48eb-be74-06e825cd7b95`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512467', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573784', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:44:17,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc06b43e-f2d4-48eb-be74-06e825cd7b95`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:44:17,027::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:44:17,027::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:44:17,028::task::993::Storage.TaskManager.Task::(_decref) Task=`bc06b43e-f2d4-48eb-be74-06e825cd7b95`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:44:26,174::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:44:26,182::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068724 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:44:26,359::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:44:26,366::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642143 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:44:32,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f3fa87e-d266-4596-91f2-74510de4f78b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:44:32,139::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:44:32,139::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642143', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068724', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:44:32,140::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f3fa87e-d266-4596-91f2-74510de4f78b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642143', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068724', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:44:32,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f3fa87e-d266-4596-91f2-74510de4f78b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:44:32,140::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:44:32,140::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:44:32,140::task::993::Storage.TaskManager.Task::(_decref) Task=`4f3fa87e-d266-4596-91f2-74510de4f78b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:44:36,186::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:44:36,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605348 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:44:36,367::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:44:36,376::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754492 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:44:46,197::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:44:46,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657103 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:44:46,378::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:44:46,386::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741904 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:44:47,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca2e968b-991c-431a-9b11-441bdc128d42`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:44:47,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:44:47,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741904', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657103', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:44:47,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca2e968b-991c-431a-9b11-441bdc128d42`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741904', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657103', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:44:47,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca2e968b-991c-431a-9b11-441bdc128d42`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:44:47,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:44:47,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:44:47,245::task::993::Storage.TaskManager.Task::(_decref) Task=`ca2e968b-991c-431a-9b11-441bdc128d42`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:44:56,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:44:56,217::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625959 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:44:56,388::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:44:56,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057573 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:45:02,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`71dd7589-87f3-495e-96ad-ea75147799e1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:45:02,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:45:02,364::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057573', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625959', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:45:02,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`71dd7589-87f3-495e-96ad-ea75147799e1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057573', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625959', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:45:02,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`71dd7589-87f3-495e-96ad-ea75147799e1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:45:02,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:45:02,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:45:02,365::task::993::Storage.TaskManager.Task::(_decref) Task=`71dd7589-87f3-495e-96ad-ea75147799e1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:45:06,220::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:45:06,228::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642739 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:45:06,396::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:45:06,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575148 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:45:16,232::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:45:16,240::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672537 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:45:16,406::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:45:16,415::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742918 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:45:17,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`714cf466-eea5-4884-884e-b5cf636a5c46`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:45:17,469::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:45:17,469::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742918', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672537', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:45:17,470::task::1191::Storage.TaskManager.Task::(prepare) Task=`714cf466-eea5-4884-884e-b5cf636a5c46`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742918', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672537', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:45:17,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`714cf466-eea5-4884-884e-b5cf636a5c46`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:45:17,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:45:17,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:45:17,470::task::993::Storage.TaskManager.Task::(_decref) Task=`714cf466-eea5-4884-884e-b5cf636a5c46`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:45:26,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:45:26,252::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680882 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:45:26,416::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:45:26,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709933 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:45:32,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`bca07f05-6583-4c89-8056-ae0d18b1c9c0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:45:32,585::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:45:32,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709933', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680882', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:45:32,587::task::1191::Storage.TaskManager.Task::(prepare) Task=`bca07f05-6583-4c89-8056-ae0d18b1c9c0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709933', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680882', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:45:32,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`bca07f05-6583-4c89-8056-ae0d18b1c9c0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:45:32,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:45:32,587::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:45:32,588::task::993::Storage.TaskManager.Task::(_decref) Task=`bca07f05-6583-4c89-8056-ae0d18b1c9c0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:45:36,255::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:45:36,263::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562611 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:45:36,425::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:45:36,434::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000816242 s, 5.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:45:46,266::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:45:46,275::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073084 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:45:46,436::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:45:46,444::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071139 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:45:47,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fe13147-3240-459f-95fb-999f1cfc856d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:45:47,696::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:45:47,696::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071139', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073084', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:45:47,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`3fe13147-3240-459f-95fb-999f1cfc856d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071139', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073084', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:45:47,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fe13147-3240-459f-95fb-999f1cfc856d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:45:47,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:45:47,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:45:47,697::task::993::Storage.TaskManager.Task::(_decref) Task=`3fe13147-3240-459f-95fb-999f1cfc856d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:45:56,279::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:45:56,287::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696394 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:45:56,446::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:45:56,453::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653522 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:46:02,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8300b48-5152-40d6-8154-52bbeff30ae0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:46:02,818::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:46:02,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653522', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696394', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:46:02,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8300b48-5152-40d6-8154-52bbeff30ae0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653522', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696394', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:46:02,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8300b48-5152-40d6-8154-52bbeff30ae0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:46:02,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:46:02,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:46:02,819::task::993::Storage.TaskManager.Task::(_decref) Task=`d8300b48-5152-40d6-8154-52bbeff30ae0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:46:06,290::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:46:06,299::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065019 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:46:06,454::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:46:06,463::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000794059 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:46:16,302::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:46:16,311::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000566707 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:46:16,464::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:46:16,472::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631011 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:46:17,931::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fe2dbb7-00eb-45d5-8267-add1d751f140`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:46:17,931::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:46:17,931::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631011', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566707', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:46:17,931::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fe2dbb7-00eb-45d5-8267-add1d751f140`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631011', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566707', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:46:17,931::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fe2dbb7-00eb-45d5-8267-add1d751f140`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:46:17,932::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:46:17,932::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:46:17,932::task::993::Storage.TaskManager.Task::(_decref) Task=`5fe2dbb7-00eb-45d5-8267-add1d751f140`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:46:26,314::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:46:26,323::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073117 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:46:26,473::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:46:26,481::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071973 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:46:33,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`585898fe-2bdb-4e83-8c70-45157362102f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:46:33,035::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:46:33,035::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071973', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073117', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:46:33,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`585898fe-2bdb-4e83-8c70-45157362102f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071973', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073117', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:46:33,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`585898fe-2bdb-4e83-8c70-45157362102f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:46:33,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:46:33,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:46:33,036::task::993::Storage.TaskManager.Task::(_decref) Task=`585898fe-2bdb-4e83-8c70-45157362102f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:46:36,326::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:46:36,334::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634166 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:46:36,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:46:36,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700397 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:46:46,338::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:46:46,347::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671803 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:46:46,492::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:46:46,500::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073669 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:46:48,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`356abbc3-c545-4236-bcca-3feaf7eddd18`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:46:48,141::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:46:48,141::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073669', 'lastCheck': '1.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671803', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:46:48,141::task::1191::Storage.TaskManager.Task::(prepare) Task=`356abbc3-c545-4236-bcca-3feaf7eddd18`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073669', 'lastCheck': '1.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671803', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:46:48,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`356abbc3-c545-4236-bcca-3feaf7eddd18`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:46:48,142::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:46:48,142::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:46:48,142::task::993::Storage.TaskManager.Task::(_decref) Task=`356abbc3-c545-4236-bcca-3feaf7eddd18`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:46:56,351::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:46:56,360::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732017 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:46:56,502::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:46:56,510::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672496 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:47:03,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`31ecf17f-61c4-49a9-bc86-d9a5023e0610`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:47:03,248::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:47:03,248::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672496', 'lastCheck': '6.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732017', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:47:03,249::task::1191::Storage.TaskManager.Task::(prepare) Task=`31ecf17f-61c4-49a9-bc86-d9a5023e0610`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672496', 'lastCheck': '6.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732017', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:47:03,249::task::595::Storage.TaskManager.Task::(_updateState) Task=`31ecf17f-61c4-49a9-bc86-d9a5023e0610`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:47:03,249::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:47:03,249::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:47:03,249::task::993::Storage.TaskManager.Task::(_decref) Task=`31ecf17f-61c4-49a9-bc86-d9a5023e0610`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:47:06,368::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:47:06,377::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692726 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:47:06,512::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:47:06,521::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705571 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:47:16,380::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:47:16,389::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610481 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:47:16,546::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:47:16,554::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618687 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:47:18,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`3449d729-b808-4ab1-a688-fd5db81b3a15`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:47:18,363::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:47:18,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618687', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610481', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:47:18,363::task::1191::Storage.TaskManager.Task::(prepare) Task=`3449d729-b808-4ab1-a688-fd5db81b3a15`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618687', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610481', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:47:18,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`3449d729-b808-4ab1-a688-fd5db81b3a15`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:47:18,363::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:47:18,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:47:18,364::task::993::Storage.TaskManager.Task::(_decref) Task=`3449d729-b808-4ab1-a688-fd5db81b3a15`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:47:26,392::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:47:26,401::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788675 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:47:26,556::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:47:26,563::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764437 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:47:33,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4b5ab16-e263-40a8-8042-66314735776a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:47:33,496::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:47:33,496::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764437', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788675', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:47:33,496::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4b5ab16-e263-40a8-8042-66314735776a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764437', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788675', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:47:33,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4b5ab16-e263-40a8-8042-66314735776a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:47:33,497::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:47:33,497::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:47:33,497::task::993::Storage.TaskManager.Task::(_decref) Task=`f4b5ab16-e263-40a8-8042-66314735776a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:47:36,404::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:47:36,412::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000890438 s, 4.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:47:36,565::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:47:36,574::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676676 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:47:46,416::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:47:46,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670603 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:47:46,576::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:47:46,584::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067345 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:47:48,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbf7f6b8-4a0e-44d3-8ef5-17b7dbb90c87`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:47:48,613::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:47:48,613::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067345', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670603', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:47:48,613::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbf7f6b8-4a0e-44d3-8ef5-17b7dbb90c87`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067345', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670603', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:47:48,613::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbf7f6b8-4a0e-44d3-8ef5-17b7dbb90c87`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:47:48,613::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:47:48,614::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:47:48,614::task::993::Storage.TaskManager.Task::(_decref) Task=`cbf7f6b8-4a0e-44d3-8ef5-17b7dbb90c87`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:47:56,427::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:47:56,435::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708211 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:47:56,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:47:56,593::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644318 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:48:03,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef529a68-d6ef-47f4-a6d5-748346c4b758`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:48:03,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:48:03,729::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644318', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708211', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:48:03,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef529a68-d6ef-47f4-a6d5-748346c4b758`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644318', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708211', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:48:03,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef529a68-d6ef-47f4-a6d5-748346c4b758`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:48:03,730::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:48:03,730::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:48:03,730::task::993::Storage.TaskManager.Task::(_decref) Task=`ef529a68-d6ef-47f4-a6d5-748346c4b758`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:48:06,439::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:48:06,448::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751697 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:06,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:06,603::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000775103 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:48:16,451::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:48:16,460::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648751 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:16,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:16,613::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696423 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:48:18,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de7023e-feec-407b-a319-c687dfe6934f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:48:18,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:48:18,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696423', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648751', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:48:18,873::task::1191::Storage.TaskManager.Task::(prepare) Task=`9de7023e-feec-407b-a319-c687dfe6934f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696423', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648751', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:48:18,873::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de7023e-feec-407b-a319-c687dfe6934f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:48:18,873::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:48:18,873::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:48:18,873::task::993::Storage.TaskManager.Task::(_decref) Task=`9de7023e-feec-407b-a319-c687dfe6934f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:48:26,463::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:48:26,471::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000444789 s, 9.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:26,614::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:26,623::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708359 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:48:33,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f26ced4-66c3-48bc-99c6-4f75449fe7b5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:48:33,994::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:48:33,994::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708359', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444789', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:48:33,994::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f26ced4-66c3-48bc-99c6-4f75449fe7b5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708359', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444789', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:48:33,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f26ced4-66c3-48bc-99c6-4f75449fe7b5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:48:33,994::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:48:33,995::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:48:33,995::task::993::Storage.TaskManager.Task::(_decref) Task=`7f26ced4-66c3-48bc-99c6-4f75449fe7b5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:48:36,475::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:48:36,483::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575511 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:36,625::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:36,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574906 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:48:46,486::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:48:46,495::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000555015 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:46,635::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:46,642::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000511622 s, 8.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:48:49,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`3362184d-f626-4abe-84bb-a3f22f012419`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:48:49,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:48:49,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511622', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555015', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:48:49,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`3362184d-f626-4abe-84bb-a3f22f012419`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511622', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555015', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:48:49,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`3362184d-f626-4abe-84bb-a3f22f012419`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:48:49,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:48:49,114::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:48:49,114::task::993::Storage.TaskManager.Task::(_decref) Task=`3362184d-f626-4abe-84bb-a3f22f012419`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:48:56,498::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:48:56,499::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:48:56,499::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:48:56,507::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000738081 s, 2.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:48:56,507::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000738081 s, 2.8 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:48:56,507::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:48:56,507::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:48:56,508::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:48:56,508::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:48:56,508::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:48:56,509::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:48:56,509::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:48:56,509::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:48:56,509::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:56,644::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:48:56,644::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:48:56,645::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:56,655::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00112199 s, 1.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:56,655::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00112199 s, 1.8 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:48:56,655::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:48:56,655::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:48:56,656::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:48:56,656::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:48:56,773::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:48:56,773::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:48:56,774::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:48:56,775::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:48:56,778::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:48:56,779::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:48:56,780::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::DEBUG::2014-08-12 17:48:56,780::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 17:48:56,781::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 17:48:56,783::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:56,783::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:48:56,792::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:48:56,792::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:48:56,952::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:48:56,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:48:56,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540556 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:56,973::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:56,974::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:48:56,974::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:48:56,975::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:48:56,975::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:48:56,975::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:48:56,976::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:57,142::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:48:57,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:48:57,151::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000520164 s, 7.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:49:04,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8dab742-8e03-492e-8a60-d4593c92b901`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:49:04,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:49:04,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520164', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540556', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:49:04,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8dab742-8e03-492e-8a60-d4593c92b901`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520164', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540556', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:49:04,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8dab742-8e03-492e-8a60-d4593c92b901`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:49:04,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:49:04,224::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:49:04,224::task::993::Storage.TaskManager.Task::(_decref) Task=`e8dab742-8e03-492e-8a60-d4593c92b901`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:49:06,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:49:06,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622093 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:49:07,153::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:49:07,161::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750802 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:49:16,975::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:49:16,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702837 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:49:17,163::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:49:17,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060033 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:49:19,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e16488c-a3d5-4fbe-b1f5-2346fe08dab6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:49:19,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:49:19,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060033', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702837', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:49:19,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e16488c-a3d5-4fbe-b1f5-2346fe08dab6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060033', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702837', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:49:19,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e16488c-a3d5-4fbe-b1f5-2346fe08dab6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:49:19,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:49:19,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:49:19,348::task::993::Storage.TaskManager.Task::(_decref) Task=`9e16488c-a3d5-4fbe-b1f5-2346fe08dab6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:49:26,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:49:26,996::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072765 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:49:27,173::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:49:27,180::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676551 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:49:34,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`381f2988-04c3-4307-a688-dd1ac268cdb9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:49:34,460::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:49:34,460::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676551', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072765', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:49:34,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`381f2988-04c3-4307-a688-dd1ac268cdb9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676551', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072765', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:49:34,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`381f2988-04c3-4307-a688-dd1ac268cdb9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:49:34,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:49:34,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:49:34,461::task::993::Storage.TaskManager.Task::(_decref) Task=`381f2988-04c3-4307-a688-dd1ac268cdb9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:49:37,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:49:37,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611432 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:49:37,181::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:49:37,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664906 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:49:47,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:49:47,022::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000723907 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:49:47,192::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:49:47,200::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594869 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:49:49,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`dfc2a7aa-c52e-4a50-b214-222e1867ec68`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:49:49,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:49:49,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594869', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723907', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:49:49,567::task::1191::Storage.TaskManager.Task::(prepare) Task=`dfc2a7aa-c52e-4a50-b214-222e1867ec68`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594869', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723907', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:49:49,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`dfc2a7aa-c52e-4a50-b214-222e1867ec68`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:49:49,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:49:49,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:49:49,568::task::993::Storage.TaskManager.Task::(_decref) Task=`dfc2a7aa-c52e-4a50-b214-222e1867ec68`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:49:57,025::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:49:57,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693673 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:49:57,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:49:57,210::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725684 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:50:04,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`5610650b-f319-4922-90d4-928fafa7ac8d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:50:04,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:50:04,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725684', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693673', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:50:04,678::task::1191::Storage.TaskManager.Task::(prepare) Task=`5610650b-f319-4922-90d4-928fafa7ac8d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725684', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693673', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:50:04,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`5610650b-f319-4922-90d4-928fafa7ac8d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:50:04,679::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:50:04,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:50:04,679::task::993::Storage.TaskManager.Task::(_decref) Task=`5610650b-f319-4922-90d4-928fafa7ac8d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:50:07,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:50:07,046::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594158 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:50:07,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:50:07,220::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059704 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:50:17,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:50:17,074::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633078 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:50:17,222::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:50:17,230::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574612 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:50:19,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0ab53c5-9ac6-483a-b5cc-13d9f1753ce2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:50:19,790::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:50:19,791::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574612', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633078', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:50:19,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0ab53c5-9ac6-483a-b5cc-13d9f1753ce2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574612', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633078', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:50:19,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0ab53c5-9ac6-483a-b5cc-13d9f1753ce2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:50:19,791::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:50:19,791::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:50:19,791::task::993::Storage.TaskManager.Task::(_decref) Task=`b0ab53c5-9ac6-483a-b5cc-13d9f1753ce2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:50:27,077::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:50:27,086::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757487 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:50:27,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:50:27,239::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579442 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:50:34,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf32a1e5-5c82-4002-8596-5fb7f3960844`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:50:34,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:50:34,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579442', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757487', 'lastCheck': '7.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:50:34,897::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf32a1e5-5c82-4002-8596-5fb7f3960844`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579442', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757487', 'lastCheck': '7.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:50:34,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf32a1e5-5c82-4002-8596-5fb7f3960844`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:50:34,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:50:34,898::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:50:34,898::task::993::Storage.TaskManager.Task::(_decref) Task=`cf32a1e5-5c82-4002-8596-5fb7f3960844`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:50:37,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:50:37,097::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650974 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:50:37,241::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:50:37,249::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00081866 s, 5.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:50:47,100::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:50:47,109::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661336 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:50:47,251::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:50:47,259::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666054 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:50:50,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba243878-e4d5-45a4-97b7-b1e5183ae59f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:50:50,009::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:50:50,009::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666054', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661336', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:50:50,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba243878-e4d5-45a4-97b7-b1e5183ae59f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666054', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661336', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:50:50,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba243878-e4d5-45a4-97b7-b1e5183ae59f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:50:50,010::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:50:50,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:50:50,010::task::993::Storage.TaskManager.Task::(_decref) Task=`ba243878-e4d5-45a4-97b7-b1e5183ae59f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:50:57,112::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:50:57,121::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717981 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:50:57,261::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:50:57,268::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725041 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:51:05,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`33833aea-76ff-4de9-b3ae-6057d17ba7c1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:51:05,114::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:51:05,114::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725041', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717981', 'lastCheck': '8.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:51:05,114::task::1191::Storage.TaskManager.Task::(prepare) Task=`33833aea-76ff-4de9-b3ae-6057d17ba7c1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725041', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717981', 'lastCheck': '8.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:51:05,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`33833aea-76ff-4de9-b3ae-6057d17ba7c1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:51:05,114::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:51:05,115::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:51:05,115::task::993::Storage.TaskManager.Task::(_decref) Task=`33833aea-76ff-4de9-b3ae-6057d17ba7c1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:51:07,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:51:07,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598968 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:51:07,269::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:51:07,278::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071719 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:51:17,136::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:51:17,144::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633808 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:51:17,280::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:51:17,288::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612974 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:51:20,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef88b28f-0803-4c62-a176-b5bb6e512991`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:51:20,220::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:51:20,221::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612974', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633808', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:51:20,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef88b28f-0803-4c62-a176-b5bb6e512991`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612974', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633808', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:51:20,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef88b28f-0803-4c62-a176-b5bb6e512991`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:51:20,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:51:20,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:51:20,222::task::993::Storage.TaskManager.Task::(_decref) Task=`ef88b28f-0803-4c62-a176-b5bb6e512991`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:51:27,148::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:51:27,156::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00129606 s, 3.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:51:27,290::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:51:27,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636883 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:51:35,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6a057f2-9a05-4b64-a9bf-14e75b786658`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:51:35,331::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:51:35,331::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636883', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129606', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:51:35,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6a057f2-9a05-4b64-a9bf-14e75b786658`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636883', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129606', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:51:35,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6a057f2-9a05-4b64-a9bf-14e75b786658`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:51:35,332::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:51:35,332::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:51:35,332::task::993::Storage.TaskManager.Task::(_decref) Task=`e6a057f2-9a05-4b64-a9bf-14e75b786658`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:51:37,160::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:51:37,168::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627901 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:51:37,298::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:51:37,307::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638572 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:51:47,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:51:47,180::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631848 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:51:47,309::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:51:47,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000967553 s, 4.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:51:50,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`be7be15b-197a-47d7-9cf8-eec14c5cc76b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:51:50,456::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:51:50,456::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000967553', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631848', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:51:50,456::task::1191::Storage.TaskManager.Task::(prepare) Task=`be7be15b-197a-47d7-9cf8-eec14c5cc76b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000967553', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631848', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:51:50,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`be7be15b-197a-47d7-9cf8-eec14c5cc76b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:51:50,456::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:51:50,457::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:51:50,457::task::993::Storage.TaskManager.Task::(_decref) Task=`be7be15b-197a-47d7-9cf8-eec14c5cc76b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:51:57,184::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:51:57,192::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696508 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:51:57,319::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:51:57,326::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731899 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:52:05,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba66bbf-0617-4702-8699-5264b2cdbf87`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:52:05,583::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:52:05,583::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731899', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696508', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:52:05,583::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ba66bbf-0617-4702-8699-5264b2cdbf87`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731899', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696508', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:52:05,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba66bbf-0617-4702-8699-5264b2cdbf87`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:52:05,584::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:52:05,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:52:05,584::task::993::Storage.TaskManager.Task::(_decref) Task=`6ba66bbf-0617-4702-8699-5264b2cdbf87`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:52:07,196::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:52:07,204::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107964 s, 3.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:52:07,327::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:52:07,336::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721678 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:52:17,208::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:52:17,217::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603169 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:52:17,337::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:52:17,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558926 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:52:20,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c909070-dc6a-471e-b671-353aa0477c22`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:52:20,681::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:52:20,682::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558926', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603169', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:52:20,682::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c909070-dc6a-471e-b671-353aa0477c22`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558926', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603169', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:52:20,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c909070-dc6a-471e-b671-353aa0477c22`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:52:20,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:52:20,682::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:52:20,683::task::993::Storage.TaskManager.Task::(_decref) Task=`5c909070-dc6a-471e-b671-353aa0477c22`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:52:27,220::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:52:27,229::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617034 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:52:27,347::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:52:27,356::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00075241 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:52:35,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c8a3fe8-fb9b-4425-b292-2dfffe6cbda2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:52:35,786::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:52:35,786::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075241', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617034', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:52:35,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c8a3fe8-fb9b-4425-b292-2dfffe6cbda2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075241', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617034', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:52:35,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c8a3fe8-fb9b-4425-b292-2dfffe6cbda2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:52:35,787::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:52:35,787::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:52:35,787::task::993::Storage.TaskManager.Task::(_decref) Task=`0c8a3fe8-fb9b-4425-b292-2dfffe6cbda2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:52:37,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:52:37,240::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609916 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:52:37,357::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:52:37,366::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700745 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:52:47,244::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:52:47,252::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683931 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:52:47,368::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:52:47,376::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595696 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:52:50,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`35e6ce64-f9a3-4042-adbb-21523f0d409c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:52:50,907::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:52:50,908::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595696', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683931', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:52:50,910::task::1191::Storage.TaskManager.Task::(prepare) Task=`35e6ce64-f9a3-4042-adbb-21523f0d409c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595696', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683931', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:52:50,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`35e6ce64-f9a3-4042-adbb-21523f0d409c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:52:50,911::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:52:50,912::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:52:50,913::task::993::Storage.TaskManager.Task::(_decref) Task=`35e6ce64-f9a3-4042-adbb-21523f0d409c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:52:57,256::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:52:57,265::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719698 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:52:57,377::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:52:57,385::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665833 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:53:06,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`70ab8dbc-8e39-4a17-84bc-8380ca8599cb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:53:06,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:53:06,018::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665833', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719698', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:53:06,018::task::1191::Storage.TaskManager.Task::(prepare) Task=`70ab8dbc-8e39-4a17-84bc-8380ca8599cb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665833', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719698', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:53:06,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`70ab8dbc-8e39-4a17-84bc-8380ca8599cb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:53:06,018::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:53:06,018::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:53:06,019::task::993::Storage.TaskManager.Task::(_decref) Task=`70ab8dbc-8e39-4a17-84bc-8380ca8599cb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:53:07,268::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:53:07,276::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625391 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:07,387::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:07,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734371 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:53:17,279::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:53:17,287::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659576 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:17,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:17,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649873 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:53:21,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5286619-ce2f-4028-a77b-9767331a39ba`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:53:21,121::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:53:21,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649873', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659576', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:53:21,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5286619-ce2f-4028-a77b-9767331a39ba`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649873', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659576', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:53:21,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5286619-ce2f-4028-a77b-9767331a39ba`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:53:21,122::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:53:21,122::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:53:21,123::task::993::Storage.TaskManager.Task::(_decref) Task=`e5286619-ce2f-4028-a77b-9767331a39ba`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:53:27,291::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:53:27,299::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749047 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:27,407::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:27,414::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588038 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:53:36,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1a5802f-e049-4e72-b07a-fff3f89a4d89`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:53:36,221::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:53:36,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588038', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749047', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:53:36,222::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1a5802f-e049-4e72-b07a-fff3f89a4d89`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588038', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749047', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:53:36,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1a5802f-e049-4e72-b07a-fff3f89a4d89`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:53:36,222::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:53:36,222::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:53:36,223::task::993::Storage.TaskManager.Task::(_decref) Task=`b1a5802f-e049-4e72-b07a-fff3f89a4d89`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:53:37,302::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:53:37,310::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738911 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:37,415::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:37,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737031 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:53:47,314::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:53:47,322::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649251 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:47,425::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:47,433::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598806 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:53:51,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`4dcd8596-4435-43d7-8c4d-18663c7adbba`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:53:51,330::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:53:51,330::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598806', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649251', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:53:51,331::task::1191::Storage.TaskManager.Task::(prepare) Task=`4dcd8596-4435-43d7-8c4d-18663c7adbba`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598806', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649251', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:53:51,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`4dcd8596-4435-43d7-8c4d-18663c7adbba`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:53:51,331::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:53:51,331::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:53:51,331::task::993::Storage.TaskManager.Task::(_decref) Task=`4dcd8596-4435-43d7-8c4d-18663c7adbba`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:53:57,325::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:53:57,326::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:53:57,326::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:53:57,335::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000612101 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:53:57,336::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000612101 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:53:57,336::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:53:57,336::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:53:57,336::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:53:57,336::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:53:57,337::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:53:57,337::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:53:57,337::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:53:57,337::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:53:57,338::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:57,435::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:53:57,436::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:53:57,436::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:57,445::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000587445 s, 3.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:57,445::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000587445 s, 3.5 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:53:57,446::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:53:57,446::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:53:57,446::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:53:57,446::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:53:57,584::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:53:57,584::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:53:57,585::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:53:57,586::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:53:57,588::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:53:57,590::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::DEBUG::2014-08-12 17:53:57,591::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 17:53:57,591::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:53:57,592::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:53:57,593::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:53:57,595::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:57,595::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:53:57,604::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:53:57,770::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:53:57,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:53:57,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574386 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:57,783::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:57,783::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:53:57,784::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:53:57,785::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:53:57,785::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:53:57,785::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:53:57,785::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:57,955::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:53:57,955::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:53:57,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056584 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:54:06,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`7bf716ab-8d01-4ba0-8fa5-44e822eeebbd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:54:06,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:54:06,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056584', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574386', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:54:06,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`7bf716ab-8d01-4ba0-8fa5-44e822eeebbd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056584', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574386', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:54:06,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`7bf716ab-8d01-4ba0-8fa5-44e822eeebbd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:54:06,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:54:06,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:54:06,547::task::993::Storage.TaskManager.Task::(_decref) Task=`7bf716ab-8d01-4ba0-8fa5-44e822eeebbd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:54:07,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:54:07,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640613 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:54:07,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:54:07,974::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068385 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:54:17,794::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:54:17,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617123 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:54:17,975::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:54:17,983::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062509 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:54:21,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`c646aee3-7d09-4c2a-b267-97c81239bb4c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:54:21,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:54:21,940::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062509', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617123', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:54:21,940::task::1191::Storage.TaskManager.Task::(prepare) Task=`c646aee3-7d09-4c2a-b267-97c81239bb4c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062509', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617123', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:54:21,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`c646aee3-7d09-4c2a-b267-97c81239bb4c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:54:21,940::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:54:21,940::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:54:21,940::task::993::Storage.TaskManager.Task::(_decref) Task=`c646aee3-7d09-4c2a-b267-97c81239bb4c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:54:27,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:54:27,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702685 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:54:27,985::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:54:27,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719699 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:54:37,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`08163089-4325-457d-bd44-b174e5052e0d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:54:37,126::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:54:37,126::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719699', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702685', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:54:37,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`08163089-4325-457d-bd44-b174e5052e0d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719699', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702685', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:54:37,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`08163089-4325-457d-bd44-b174e5052e0d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:54:37,127::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:54:37,127::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:54:37,127::task::993::Storage.TaskManager.Task::(_decref) Task=`08163089-4325-457d-bd44-b174e5052e0d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:54:37,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:54:37,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067607 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:54:37,994::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:54:38,003::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000793907 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:54:47,829::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:54:47,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548676 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:54:48,004::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:54:48,013::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780927 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:54:52,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a8c6fff-39bc-4824-a863-46a76a7ba011`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:54:52,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:54:52,236::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780927', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548676', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:54:52,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a8c6fff-39bc-4824-a863-46a76a7ba011`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780927', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548676', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:54:52,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a8c6fff-39bc-4824-a863-46a76a7ba011`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:54:52,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:54:52,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:54:52,236::task::993::Storage.TaskManager.Task::(_decref) Task=`3a8c6fff-39bc-4824-a863-46a76a7ba011`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:54:57,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:54:57,857::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00755497 s, 542 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:54:58,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:54:58,022::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607961 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:55:07,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`455aef3d-e7c8-4271-9fa0-5397fc569a88`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:55:07,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:55:07,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607961', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00755497', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:55:07,354::task::1191::Storage.TaskManager.Task::(prepare) Task=`455aef3d-e7c8-4271-9fa0-5397fc569a88`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607961', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00755497', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:55:07,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`455aef3d-e7c8-4271-9fa0-5397fc569a88`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:55:07,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:55:07,355::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:55:07,355::task::993::Storage.TaskManager.Task::(_decref) Task=`455aef3d-e7c8-4271-9fa0-5397fc569a88`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:55:07,860::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:55:07,868::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637594 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:55:08,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:55:08,033::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000794225 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:55:17,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:55:17,880::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686044 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:55:18,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:55:18,042::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000524885 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:55:22,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c1df70b-d0f7-4837-bf1d-9754a5d83a68`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:55:22,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:55:22,474::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524885', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686044', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:55:22,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c1df70b-d0f7-4837-bf1d-9754a5d83a68`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524885', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686044', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:55:22,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c1df70b-d0f7-4837-bf1d-9754a5d83a68`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:55:22,476::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:55:22,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:55:22,478::task::993::Storage.TaskManager.Task::(_decref) Task=`7c1df70b-d0f7-4837-bf1d-9754a5d83a68`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:55:27,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:55:27,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718633 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:55:28,044::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:55:28,051::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699518 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:55:37,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`71c99b45-7a71-4ebe-9011-168fc30bee3b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:55:37,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:55:37,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699518', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718633', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:55:37,684::task::1191::Storage.TaskManager.Task::(prepare) Task=`71c99b45-7a71-4ebe-9011-168fc30bee3b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699518', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718633', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:55:37,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`71c99b45-7a71-4ebe-9011-168fc30bee3b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:55:37,684::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:55:37,685::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:55:37,685::task::993::Storage.TaskManager.Task::(_decref) Task=`71c99b45-7a71-4ebe-9011-168fc30bee3b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:55:37,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:55:37,904::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605663 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:55:38,052::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:55:38,061::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578828 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:55:47,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:55:47,915::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625307 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:55:48,062::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:55:48,071::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632938 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:55:52,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`0551f85b-b0d6-441d-a313-25ab5c019b5a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:55:52,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:55:52,835::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632938', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625307', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:55:52,836::task::1191::Storage.TaskManager.Task::(prepare) Task=`0551f85b-b0d6-441d-a313-25ab5c019b5a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632938', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625307', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:55:52,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`0551f85b-b0d6-441d-a313-25ab5c019b5a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:55:52,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:55:52,838::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:55:52,839::task::993::Storage.TaskManager.Task::(_decref) Task=`0551f85b-b0d6-441d-a313-25ab5c019b5a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:55:57,918::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:55:57,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690572 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:55:58,073::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:55:58,080::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645703 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:56:07,944::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:56:07,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064582 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:56:07,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`faaa2af6-e2dc-4d16-aaf1-39bab4a23631`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:56:07,977::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:56:07,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645703', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064582', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:56:07,978::task::1191::Storage.TaskManager.Task::(prepare) Task=`faaa2af6-e2dc-4d16-aaf1-39bab4a23631`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645703', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064582', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:56:07,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`faaa2af6-e2dc-4d16-aaf1-39bab4a23631`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:56:07,978::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:56:07,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:56:07,979::task::993::Storage.TaskManager.Task::(_decref) Task=`faaa2af6-e2dc-4d16-aaf1-39bab4a23631`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 17:56:08,081::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:56:08,090::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727857 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:56:17,955::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:56:17,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717503 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:56:18,091::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:56:18,100::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676946 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:56:23,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`f67b8f6d-4c2d-4a57-b36f-c40a0de8bfed`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:56:23,090::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:56:23,091::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676946', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717503', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:56:23,092::task::1191::Storage.TaskManager.Task::(prepare) Task=`f67b8f6d-4c2d-4a57-b36f-c40a0de8bfed`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676946', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717503', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:56:23,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`f67b8f6d-4c2d-4a57-b36f-c40a0de8bfed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:56:23,093::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:56:23,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:56:23,094::task::993::Storage.TaskManager.Task::(_decref) Task=`f67b8f6d-4c2d-4a57-b36f-c40a0de8bfed`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:56:27,967::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:56:27,974::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814091 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:56:28,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:56:28,108::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066955 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:56:37,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:56:37,986::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605899 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:56:38,110::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:56:38,119::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624839 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:56:38,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3772730-66de-4030-9fa2-97878e85e244`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:56:38,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:56:38,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624839', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605899', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:56:38,213::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3772730-66de-4030-9fa2-97878e85e244`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624839', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605899', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:56:38,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3772730-66de-4030-9fa2-97878e85e244`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:56:38,213::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:56:38,214::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:56:38,214::task::993::Storage.TaskManager.Task::(_decref) Task=`b3772730-66de-4030-9fa2-97878e85e244`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:56:47,989::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:56:47,998::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649445 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:56:48,121::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:56:48,129::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681142 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:56:53,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`da76bec2-6e8f-4156-80fe-5bcafa2df85c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:56:53,325::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:56:53,326::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681142', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649445', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:56:53,327::task::1191::Storage.TaskManager.Task::(prepare) Task=`da76bec2-6e8f-4156-80fe-5bcafa2df85c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681142', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649445', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:56:53,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`da76bec2-6e8f-4156-80fe-5bcafa2df85c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:56:53,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:56:53,329::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:56:53,330::task::993::Storage.TaskManager.Task::(_decref) Task=`da76bec2-6e8f-4156-80fe-5bcafa2df85c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:56:58,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:56:58,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000951588 s, 4.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:56:58,131::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:56:58,138::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607547 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:57:08,013::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:57:08,022::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063292 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:57:08,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:57:08,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707789 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:57:08,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bb6c366-d1ee-4b1f-97b2-be0ab5770bdd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:57:08,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:57:08,464::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707789', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063292', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:57:08,464::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bb6c366-d1ee-4b1f-97b2-be0ab5770bdd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707789', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063292', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:57:08,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bb6c366-d1ee-4b1f-97b2-be0ab5770bdd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:57:08,464::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:57:08,464::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:57:08,464::task::993::Storage.TaskManager.Task::(_decref) Task=`5bb6c366-d1ee-4b1f-97b2-be0ab5770bdd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:57:18,025::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:57:18,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589161 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:57:18,149::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:57:18,157::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000798536 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:57:23,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd277543-77fe-4c89-8082-a8b3e75f0868`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:57:23,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:57:23,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000798536', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589161', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:57:23,715::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd277543-77fe-4c89-8082-a8b3e75f0868`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000798536', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589161', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:57:23,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd277543-77fe-4c89-8082-a8b3e75f0868`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:57:23,715::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:57:23,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:57:23,715::task::993::Storage.TaskManager.Task::(_decref) Task=`bd277543-77fe-4c89-8082-a8b3e75f0868`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:57:28,050::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:57:28,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727755 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:57:28,159::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:57:28,166::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742163 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:57:38,062::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:57:38,070::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672683 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:57:38,168::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:57:38,176::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729185 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:57:38,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`d83a6792-6e59-4735-bdf4-18c4e1a0aa9a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:57:38,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:57:38,868::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729185', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672683', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:57:38,868::task::1191::Storage.TaskManager.Task::(prepare) Task=`d83a6792-6e59-4735-bdf4-18c4e1a0aa9a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729185', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672683', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:57:38,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`d83a6792-6e59-4735-bdf4-18c4e1a0aa9a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:57:38,868::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:57:38,868::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:57:38,869::task::993::Storage.TaskManager.Task::(_decref) Task=`d83a6792-6e59-4735-bdf4-18c4e1a0aa9a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:57:48,073::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:57:48,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606887 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:57:48,178::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:57:48,185::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000556748 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:57:53,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e9f85a2-4917-43ba-b761-d1805951b754`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:57:53,975::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:57:53,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556748', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606887', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:57:53,976::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e9f85a2-4917-43ba-b761-d1805951b754`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556748', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606887', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:57:53,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e9f85a2-4917-43ba-b761-d1805951b754`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:57:53,976::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:57:53,976::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:57:53,976::task::993::Storage.TaskManager.Task::(_decref) Task=`8e9f85a2-4917-43ba-b761-d1805951b754`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:57:58,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:57:58,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588432 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:57:58,187::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:57:58,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669451 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:58:08,097::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:58:08,105::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592061 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:08,196::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:08,204::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000763533 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:58:09,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c917f56-96a1-4107-a459-1737add13700`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:58:09,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:58:09,087::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763533', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592061', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:58:09,087::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c917f56-96a1-4107-a459-1737add13700`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000763533', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592061', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:58:09,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c917f56-96a1-4107-a459-1737add13700`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:58:09,087::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:58:09,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:58:09,088::task::993::Storage.TaskManager.Task::(_decref) Task=`7c917f56-96a1-4107-a459-1737add13700`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:58:18,108::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:58:18,116::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636406 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:18,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:18,213::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000577194 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:58:24,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d40853e-abee-4076-956a-204ba16d919a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:58:24,202::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:58:24,203::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577194', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636406', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:58:24,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d40853e-abee-4076-956a-204ba16d919a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577194', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636406', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:58:24,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d40853e-abee-4076-956a-204ba16d919a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:58:24,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:58:24,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:58:24,204::task::993::Storage.TaskManager.Task::(_decref) Task=`3d40853e-abee-4076-956a-204ba16d919a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:58:28,119::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:58:28,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696941 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:28,215::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:28,222::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610633 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:58:38,131::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:58:38,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000532111 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:38,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:38,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671829 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:58:39,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`e592754d-2817-4357-9681-90f5baa160a3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:58:39,315::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:58:39,316::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671829', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532111', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:58:39,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`e592754d-2817-4357-9681-90f5baa160a3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671829', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532111', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:58:39,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`e592754d-2817-4357-9681-90f5baa160a3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:58:39,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:58:39,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:58:39,316::task::993::Storage.TaskManager.Task::(_decref) Task=`e592754d-2817-4357-9681-90f5baa160a3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:58:48,142::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:58:48,150::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000772871 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:48,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:48,241::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739118 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:58:54,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`48e1fb01-4bd9-42e7-98b7-3a8ff8a274d6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:58:54,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:58:54,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739118', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772871', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:58:54,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`48e1fb01-4bd9-42e7-98b7-3a8ff8a274d6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739118', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000772871', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:58:54,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`48e1fb01-4bd9-42e7-98b7-3a8ff8a274d6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:58:54,435::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:58:54,435::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:58:54,435::task::993::Storage.TaskManager.Task::(_decref) Task=`48e1fb01-4bd9-42e7-98b7-3a8ff8a274d6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:58:58,153::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 17:58:58,154::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:58:58,154::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:58:58,163::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000758287 s, 2.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:58:58,163::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000758287 s, 2.7 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 17:58:58,163::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 17:58:58,163::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 17:58:58,163::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 17:58:58,164::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:58:58,164::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:58:58,164::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:58:58,164::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:58:58,165::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:58:58,165::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:58,243::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 17:58:58,243::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:58:58,244::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:58,252::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00058828 s, 3.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:58,253::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00058828 s, 3.5 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 17:58:58,253::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 17:58:58,253::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 17:58:58,253::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 17:58:58,254::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 17:58:58,428::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:58:58,429::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 17:58:58,430::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 17:58:58,431::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:58:58,433::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 17:58:58,434::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 17:58:58,435::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 17:58:58,436::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:58:58,436::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 17:58:58,438::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:58,446::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:58:58,447::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 17:58:58,447::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 17:58:58,605::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:58:58,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:58:58,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000478333 s, 8.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:58,624::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:58,625::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 17:58:58,625::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 17:58:58,626::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 17:58:58,626::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 17:58:58,626::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 17:58:58,626::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:58,793::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:58:58,793::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:58:58,802::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603662 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:59:08,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:59:08,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600135 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:59:08,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:59:08,812::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713952 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:59:09,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`84b262c4-df16-4a0d-b380-de478e72535d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:59:09,550::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:59:09,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713952', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600135', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:59:09,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`84b262c4-df16-4a0d-b380-de478e72535d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713952', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600135', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:59:09,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`84b262c4-df16-4a0d-b380-de478e72535d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:59:09,578::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:59:09,578::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:59:09,578::task::993::Storage.TaskManager.Task::(_decref) Task=`84b262c4-df16-4a0d-b380-de478e72535d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:59:18,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:59:18,639::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617639 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:59:18,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:59:18,820::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000513669 s, 8.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:59:24,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a4c0985-8161-472e-a5ec-5d596627050d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:59:24,692::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:59:24,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513669', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617639', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:59:24,692::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a4c0985-8161-472e-a5ec-5d596627050d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513669', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617639', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:59:24,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a4c0985-8161-472e-a5ec-5d596627050d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:59:24,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:59:24,693::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:59:24,693::task::993::Storage.TaskManager.Task::(_decref) Task=`7a4c0985-8161-472e-a5ec-5d596627050d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:59:28,642::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:59:28,650::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717341 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:59:28,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:59:28,829::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646175 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 17:59:38,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:59:38,661::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000555303 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:59:38,830::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:59:38,839::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682219 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:59:39,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6fd4a7b-05e6-47cb-955e-cfb27fd00e86`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:59:39,841::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:59:39,841::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682219', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555303', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:59:39,841::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6fd4a7b-05e6-47cb-955e-cfb27fd00e86`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682219', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555303', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:59:39,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6fd4a7b-05e6-47cb-955e-cfb27fd00e86`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:59:39,842::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:59:39,842::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:59:39,842::task::993::Storage.TaskManager.Task::(_decref) Task=`e6fd4a7b-05e6-47cb-955e-cfb27fd00e86`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:59:48,667::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:59:48,679::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583638 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:59:48,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:59:48,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000556644 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 17:59:54,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`3450abb9-4e5c-41a1-9ab7-8223e1cde30e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 17:59:54,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 17:59:54,949::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556644', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583638', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:59:54,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`3450abb9-4e5c-41a1-9ab7-8223e1cde30e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556644', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583638', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 17:59:54,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`3450abb9-4e5c-41a1-9ab7-8223e1cde30e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 17:59:54,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 17:59:54,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 17:59:54,950::task::993::Storage.TaskManager.Task::(_decref) Task=`3450abb9-4e5c-41a1-9ab7-8223e1cde30e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 17:59:58,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 17:59:58,701::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074071 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 17:59:58,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 17:59:58,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637239 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:00:08,705::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:00:08,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661274 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:00:08,864::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:00:08,872::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000809303 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:00:10,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b92ef79-d33f-4381-885e-6ef8c1944633`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:00:10,065::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:00:10,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809303', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661274', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:00:10,066::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b92ef79-d33f-4381-885e-6ef8c1944633`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809303', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661274', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:00:10,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b92ef79-d33f-4381-885e-6ef8c1944633`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:00:10,066::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:00:10,066::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:00:10,066::task::993::Storage.TaskManager.Task::(_decref) Task=`8b92ef79-d33f-4381-885e-6ef8c1944633`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:00:18,717::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:00:18,726::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058683 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:00:18,874::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:00:18,883::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000566225 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:00:25,249::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab9192f1-838a-4186-a0b0-17b1a34d32bc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:00:25,250::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:00:25,250::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566225', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058683', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:00:25,250::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab9192f1-838a-4186-a0b0-17b1a34d32bc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566225', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058683', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:00:25,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab9192f1-838a-4186-a0b0-17b1a34d32bc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:00:25,251::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:00:25,251::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:00:25,251::task::993::Storage.TaskManager.Task::(_decref) Task=`ab9192f1-838a-4186-a0b0-17b1a34d32bc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:00:28,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:00:28,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648319 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:00:28,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:00:28,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678718 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:00:38,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:00:38,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601913 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:00:38,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:00:38,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649035 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:00:40,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca557c9b-4fa1-454e-942c-e03f1aeaa7d6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:00:40,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:00:40,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649035', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601913', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:00:40,361::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca557c9b-4fa1-454e-942c-e03f1aeaa7d6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649035', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601913', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:00:40,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca557c9b-4fa1-454e-942c-e03f1aeaa7d6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:00:40,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:00:40,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:00:40,362::task::993::Storage.TaskManager.Task::(_decref) Task=`ca557c9b-4fa1-454e-942c-e03f1aeaa7d6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:00:48,754::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:00:48,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625257 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:00:48,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:00:48,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070484 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:00:55,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`08dc2a2a-9c0b-4ede-8312-fdb433755097`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:00:55,486::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:00:55,486::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070484', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625257', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:00:55,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`08dc2a2a-9c0b-4ede-8312-fdb433755097`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070484', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625257', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:00:55,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`08dc2a2a-9c0b-4ede-8312-fdb433755097`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:00:55,487::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:00:55,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:00:55,487::task::993::Storage.TaskManager.Task::(_decref) Task=`08dc2a2a-9c0b-4ede-8312-fdb433755097`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:00:58,766::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:00:58,774::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741064 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:00:58,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:00:58,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636833 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:01:08,778::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:01:08,786::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615162 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:01:08,921::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:01:08,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683935 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:01:10,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`51e7bc95-d8b0-4459-8ae7-e605947aa543`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:01:10,595::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:01:10,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683935', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615162', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:01:10,595::task::1191::Storage.TaskManager.Task::(prepare) Task=`51e7bc95-d8b0-4459-8ae7-e605947aa543`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683935', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615162', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:01:10,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`51e7bc95-d8b0-4459-8ae7-e605947aa543`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:01:10,596::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:01:10,596::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:01:10,596::task::993::Storage.TaskManager.Task::(_decref) Task=`51e7bc95-d8b0-4459-8ae7-e605947aa543`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:01:18,790::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:01:18,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638279 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:01:18,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:01:18,939::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548409 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:01:25,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`930afc22-a79f-4b96-b041-00ce6bcf797e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:01:25,717::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:01:25,717::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548409', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638279', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:01:25,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`930afc22-a79f-4b96-b041-00ce6bcf797e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548409', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638279', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:01:25,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`930afc22-a79f-4b96-b041-00ce6bcf797e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:01:25,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:01:25,718::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:01:25,718::task::993::Storage.TaskManager.Task::(_decref) Task=`930afc22-a79f-4b96-b041-00ce6bcf797e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:01:28,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:01:28,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690405 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:01:28,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:01:28,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679401 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:01:38,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:01:38,821::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610834 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:01:38,950::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:01:38,959::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609935 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:01:40,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f3ba227-47d7-48ab-be57-a91e6551b5a2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:01:40,829::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:01:40,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609935', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610834', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:01:40,829::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f3ba227-47d7-48ab-be57-a91e6551b5a2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609935', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610834', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:01:40,830::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f3ba227-47d7-48ab-be57-a91e6551b5a2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:01:40,830::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:01:40,830::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:01:40,830::task::993::Storage.TaskManager.Task::(_decref) Task=`6f3ba227-47d7-48ab-be57-a91e6551b5a2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:01:48,838::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:01:48,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630418 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:01:48,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:01:48,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006881 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:01:55,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`156e5b2f-35d0-4c7d-83fb-57baa1fbbfa3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:01:55,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:01:55,940::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006881', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630418', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:01:55,940::task::1191::Storage.TaskManager.Task::(prepare) Task=`156e5b2f-35d0-4c7d-83fb-57baa1fbbfa3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006881', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630418', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:01:55,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`156e5b2f-35d0-4c7d-83fb-57baa1fbbfa3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:01:55,941::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:01:55,941::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:01:55,941::task::993::Storage.TaskManager.Task::(_decref) Task=`156e5b2f-35d0-4c7d-83fb-57baa1fbbfa3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:01:58,849::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:01:58,858::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106106 s, 3.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:01:58,970::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:01:58,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682617 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:02:08,861::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:02:08,869::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610589 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:02:08,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:02:08,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000743436 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:02:11,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`eacc7dda-7c79-4660-8a9b-8fad7592f50b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:02:11,047::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:02:11,047::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743436', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610589', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:02:11,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`eacc7dda-7c79-4660-8a9b-8fad7592f50b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743436', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610589', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:02:11,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`eacc7dda-7c79-4660-8a9b-8fad7592f50b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:02:11,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:02:11,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:02:11,048::task::993::Storage.TaskManager.Task::(_decref) Task=`eacc7dda-7c79-4660-8a9b-8fad7592f50b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:02:18,883::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:02:18,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608835 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:02:18,989::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:02:18,998::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554089 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:02:26,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bf36cb5-bea8-413e-adca-300b02221589`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:02:26,165::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:02:26,166::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554089', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608835', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:02:26,166::task::1191::Storage.TaskManager.Task::(prepare) Task=`2bf36cb5-bea8-413e-adca-300b02221589`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554089', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608835', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:02:26,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bf36cb5-bea8-413e-adca-300b02221589`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:02:26,166::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:02:26,166::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:02:26,167::task::993::Storage.TaskManager.Task::(_decref) Task=`2bf36cb5-bea8-413e-adca-300b02221589`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:02:28,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:02:28,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621974 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:02:28,999::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:02:29,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672665 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:02:38,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:02:38,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000561297 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:02:39,008::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:02:39,017::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730817 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:02:41,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`9dc16663-e269-430c-b2fc-b99b726ea7f7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:02:41,278::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:02:41,279::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730817', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561297', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:02:41,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`9dc16663-e269-430c-b2fc-b99b726ea7f7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730817', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561297', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:02:41,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`9dc16663-e269-430c-b2fc-b99b726ea7f7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:02:41,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:02:41,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:02:41,279::task::993::Storage.TaskManager.Task::(_decref) Task=`9dc16663-e269-430c-b2fc-b99b726ea7f7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:02:48,918::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:02:48,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000478674 s, 8.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:02:49,018::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:02:49,027::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612551 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:02:56,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1f5b9f5-1380-4be5-b1e2-373d5b39f904`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:02:56,398::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:02:56,398::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612551', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478674', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:02:56,398::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1f5b9f5-1380-4be5-b1e2-373d5b39f904`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612551', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478674', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:02:56,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1f5b9f5-1380-4be5-b1e2-373d5b39f904`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:02:56,399::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:02:56,399::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:02:56,399::task::993::Storage.TaskManager.Task::(_decref) Task=`b1f5b9f5-1380-4be5-b1e2-373d5b39f904`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:02:58,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:02:58,937::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000691759 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:02:59,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:02:59,036::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623207 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:03:08,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:03:08,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588541 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:09,037::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:09,046::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614529 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:03:11,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`1426bafd-8d3c-4658-9635-46235e566f20`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:03:11,508::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:03:11,508::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614529', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588541', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:03:11,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`1426bafd-8d3c-4658-9635-46235e566f20`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614529', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588541', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:03:11,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`1426bafd-8d3c-4658-9635-46235e566f20`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:03:11,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:03:11,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:03:11,509::task::993::Storage.TaskManager.Task::(_decref) Task=`1426bafd-8d3c-4658-9635-46235e566f20`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:03:18,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:03:18,960::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063502 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:19,048::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:19,057::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00117048 s, 3.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:03:26,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`80139f9c-d3c7-4037-ac29-86fa3a0c72d1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:03:26,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:03:26,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117048', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063502', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:03:26,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`80139f9c-d3c7-4037-ac29-86fa3a0c72d1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117048', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063502', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:03:26,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`80139f9c-d3c7-4037-ac29-86fa3a0c72d1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:03:26,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:03:26,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:03:26,623::task::993::Storage.TaskManager.Task::(_decref) Task=`80139f9c-d3c7-4037-ac29-86fa3a0c72d1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:03:28,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:03:28,980::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779099 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:29,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:29,065::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581799 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:03:38,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:03:38,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607758 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:39,067::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:39,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709216 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:03:41,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`1565030c-8ad4-46a4-848e-2cb746005860`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:03:41,730::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:03:41,730::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709216', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607758', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:03:41,730::task::1191::Storage.TaskManager.Task::(prepare) Task=`1565030c-8ad4-46a4-848e-2cb746005860`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709216', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607758', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:03:41,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`1565030c-8ad4-46a4-848e-2cb746005860`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:03:41,731::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:03:41,731::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:03:41,731::task::993::Storage.TaskManager.Task::(_decref) Task=`1565030c-8ad4-46a4-848e-2cb746005860`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:03:48,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:03:49,007::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634822 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:49,077::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:49,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587944 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:03:56,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`41b39edc-65d0-4095-840b-b95841321162`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:03:56,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:03:56,949::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587944', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634822', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:03:56,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`41b39edc-65d0-4095-840b-b95841321162`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587944', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634822', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:03:56,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`41b39edc-65d0-4095-840b-b95841321162`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:03:56,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:03:56,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:03:56,950::task::993::Storage.TaskManager.Task::(_decref) Task=`41b39edc-65d0-4095-840b-b95841321162`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:03:59,011::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:03:59,012::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:03:59,012::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:03:59,020::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000691919 s, 3.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:03:59,021::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000691919 s, 3.0 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:03:59,021::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:03:59,021::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:03:59,021::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:03:59,022::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:03:59,022::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:03:59,022::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:03:59,022::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:03:59,023::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:03:59,023::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:59,086::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:03:59,087::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:03:59,088::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:59,104::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000629144 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:59,104::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000629144 s, 3.3 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:03:59,104::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:03:59,104::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:03:59,104::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:03:59,105::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 18:03:59,332::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:03:59,332::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:03:59,333::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 18:03:59,334::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:03:59,336::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 18:03:59,338::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:03:59,339::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-16::DEBUG::2014-08-12 18:03:59,339::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 18:03:59,339::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:03:59,342::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:03:59,342::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:59,351::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:03:59,352::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:03:59,510::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:03:59,511::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:03:59,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00212782 s, 1.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:59,547::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:59,547::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:03:59,547::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:03:59,548::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:03:59,548::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:03:59,549::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:03:59,549::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:59,714::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:03:59,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:03:59,723::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00055281 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:04:09,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:04:09,534::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616722 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:04:09,725::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:04:09,733::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102683 s, 4.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:04:12,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`97eebddf-a8a8-40f1-8d28-531b19d56656`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:04:12,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:04:12,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102683', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616722', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:04:12,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`97eebddf-a8a8-40f1-8d28-531b19d56656`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102683', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616722', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:04:12,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`97eebddf-a8a8-40f1-8d28-531b19d56656`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:04:12,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:04:12,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:04:12,113::task::993::Storage.TaskManager.Task::(_decref) Task=`97eebddf-a8a8-40f1-8d28-531b19d56656`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:04:19,537::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:04:19,546::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646461 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:04:19,735::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:04:19,743::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569751 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:04:27,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe9cabaa-f575-4800-955a-6c5464253e9e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:04:27,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:04:27,237::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569751', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646461', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:04:27,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe9cabaa-f575-4800-955a-6c5464253e9e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569751', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646461', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:04:27,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe9cabaa-f575-4800-955a-6c5464253e9e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:04:27,238::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:04:27,238::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:04:27,238::task::993::Storage.TaskManager.Task::(_decref) Task=`fe9cabaa-f575-4800-955a-6c5464253e9e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:04:29,549::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:04:29,557::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740405 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:04:29,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:04:29,753::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742805 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:04:39,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:04:39,569::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000549267 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:04:39,754::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:04:39,763::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686544 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:04:42,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`55bcb786-4042-4c44-ada0-0c5d251cd2f6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:04:42,348::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:04:42,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686544', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549267', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:04:42,348::task::1191::Storage.TaskManager.Task::(prepare) Task=`55bcb786-4042-4c44-ada0-0c5d251cd2f6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686544', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549267', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:04:42,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`55bcb786-4042-4c44-ada0-0c5d251cd2f6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:04:42,349::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:04:42,349::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:04:42,349::task::993::Storage.TaskManager.Task::(_decref) Task=`55bcb786-4042-4c44-ada0-0c5d251cd2f6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:04:49,572::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:04:49,580::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625109 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:04:49,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:04:49,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631781 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:04:57,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`01cdf01e-4742-4ecc-a21d-f1609be68b9f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:04:57,457::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:04:57,457::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631781', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625109', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:04:57,457::task::1191::Storage.TaskManager.Task::(prepare) Task=`01cdf01e-4742-4ecc-a21d-f1609be68b9f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631781', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625109', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:04:57,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`01cdf01e-4742-4ecc-a21d-f1609be68b9f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:04:57,457::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:04:57,458::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:04:57,458::task::993::Storage.TaskManager.Task::(_decref) Task=`01cdf01e-4742-4ecc-a21d-f1609be68b9f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:04:59,583::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:04:59,591::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651522 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:04:59,774::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:04:59,781::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612113 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:05:09,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:05:09,603::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655208 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:05:09,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:05:09,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636125 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:05:12,562::task::595::Storage.TaskManager.Task::(_updateState) Task=`95140849-4f1a-4591-8af8-085e68dee6a7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:05:12,563::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:05:12,563::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636125', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655208', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:05:12,563::task::1191::Storage.TaskManager.Task::(prepare) Task=`95140849-4f1a-4591-8af8-085e68dee6a7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636125', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655208', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:05:12,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`95140849-4f1a-4591-8af8-085e68dee6a7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:05:12,563::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:05:12,564::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:05:12,564::task::993::Storage.TaskManager.Task::(_decref) Task=`95140849-4f1a-4591-8af8-085e68dee6a7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:05:19,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:05:19,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667505 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:05:19,793::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:05:19,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693107 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:05:27,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`49935a67-7a17-4312-91f0-8c1f7ce7602c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:05:27,670::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:05:27,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693107', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667505', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:05:27,670::task::1191::Storage.TaskManager.Task::(prepare) Task=`49935a67-7a17-4312-91f0-8c1f7ce7602c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693107', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667505', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:05:27,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`49935a67-7a17-4312-91f0-8c1f7ce7602c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:05:27,671::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:05:27,671::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:05:27,671::task::993::Storage.TaskManager.Task::(_decref) Task=`49935a67-7a17-4312-91f0-8c1f7ce7602c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:05:29,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:05:29,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000768241 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:05:29,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:05:29,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677906 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:05:39,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:05:39,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606601 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:05:39,812::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:05:39,821::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000820322 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:05:42,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`db90ad41-b388-44d0-b211-4fdf7310e5af`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:05:42,773::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:05:42,774::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820322', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606601', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:05:42,774::task::1191::Storage.TaskManager.Task::(prepare) Task=`db90ad41-b388-44d0-b211-4fdf7310e5af`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820322', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606601', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:05:42,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`db90ad41-b388-44d0-b211-4fdf7310e5af`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:05:42,774::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:05:42,774::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:05:42,774::task::993::Storage.TaskManager.Task::(_decref) Task=`db90ad41-b388-44d0-b211-4fdf7310e5af`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:05:49,642::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:05:49,650::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734228 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:05:49,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:05:49,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006179 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:05:57,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`020049c7-b51f-4406-a701-19fba4001834`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:05:57,873::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:05:57,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006179', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734228', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:05:57,873::task::1191::Storage.TaskManager.Task::(prepare) Task=`020049c7-b51f-4406-a701-19fba4001834`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006179', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734228', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:05:57,873::task::595::Storage.TaskManager.Task::(_updateState) Task=`020049c7-b51f-4406-a701-19fba4001834`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:05:57,873::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:05:57,874::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:05:57,874::task::993::Storage.TaskManager.Task::(_decref) Task=`020049c7-b51f-4406-a701-19fba4001834`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:05:59,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:05:59,662::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066593 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:05:59,832::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:05:59,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624528 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:06:09,669::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:06:09,677::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644137 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:06:09,841::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:06:09,849::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074657 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:06:12,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc454436-3ad4-4595-92aa-ffbcb69ae2b8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:06:12,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:06:12,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074657', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644137', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:06:12,981::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc454436-3ad4-4595-92aa-ffbcb69ae2b8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074657', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644137', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:06:12,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc454436-3ad4-4595-92aa-ffbcb69ae2b8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:06:12,981::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:06:12,981::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:06:12,981::task::993::Storage.TaskManager.Task::(_decref) Task=`cc454436-3ad4-4595-92aa-ffbcb69ae2b8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:06:19,680::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:06:19,690::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693929 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:06:19,851::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:06:19,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592785 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:06:28,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3399a67-277c-4bd1-9168-36b0cc00060c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:06:28,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:06:28,093::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592785', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693929', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:06:28,093::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3399a67-277c-4bd1-9168-36b0cc00060c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592785', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693929', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:06:28,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3399a67-277c-4bd1-9168-36b0cc00060c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:06:28,093::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:06:28,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:06:28,094::task::993::Storage.TaskManager.Task::(_decref) Task=`b3399a67-277c-4bd1-9168-36b0cc00060c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:06:29,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:06:29,702::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672326 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:06:29,860::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:06:29,869::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649555 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:06:39,720::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:06:39,728::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609848 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:06:39,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:06:39,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648094 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:06:43,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`19aa88b4-3f70-4322-836b-e49ddf638edb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:06:43,221::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:06:43,221::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648094', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609848', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:06:43,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`19aa88b4-3f70-4322-836b-e49ddf638edb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648094', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609848', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:06:43,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`19aa88b4-3f70-4322-836b-e49ddf638edb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:06:43,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:06:43,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:06:43,222::task::993::Storage.TaskManager.Task::(_decref) Task=`19aa88b4-3f70-4322-836b-e49ddf638edb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:06:49,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:06:49,748::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716835 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:06:49,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:06:49,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613923 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:06:58,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`66c7705f-5492-4a67-834c-b50996d103a1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:06:58,333::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:06:58,333::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613923', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716835', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:06:58,333::task::1191::Storage.TaskManager.Task::(prepare) Task=`66c7705f-5492-4a67-834c-b50996d103a1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613923', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716835', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:06:58,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`66c7705f-5492-4a67-834c-b50996d103a1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:06:58,334::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:06:58,334::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:06:58,334::task::993::Storage.TaskManager.Task::(_decref) Task=`66c7705f-5492-4a67-834c-b50996d103a1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:06:59,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:06:59,763::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695385 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:06:59,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:06:59,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704401 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:07:09,766::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:07:09,774::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602419 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:07:09,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:07:09,912::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554273 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:07:13,439::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c733796-2950-4a24-8757-8bd5729b0ac6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:07:13,439::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:07:13,440::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554273', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602419', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:07:13,440::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c733796-2950-4a24-8757-8bd5729b0ac6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554273', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602419', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:07:13,440::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c733796-2950-4a24-8757-8bd5729b0ac6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:07:13,440::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:07:13,441::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:07:13,441::task::993::Storage.TaskManager.Task::(_decref) Task=`1c733796-2950-4a24-8757-8bd5729b0ac6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:07:19,778::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:07:19,787::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593068 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:07:19,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:07:19,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568315 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:07:28,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d17f94c-0525-4f8d-94ca-1e2aebd9f570`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:07:28,546::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:07:28,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568315', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593068', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:07:28,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d17f94c-0525-4f8d-94ca-1e2aebd9f570`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568315', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593068', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:07:28,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d17f94c-0525-4f8d-94ca-1e2aebd9f570`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:07:28,547::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:07:28,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:07:28,547::task::993::Storage.TaskManager.Task::(_decref) Task=`7d17f94c-0525-4f8d-94ca-1e2aebd9f570`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:07:29,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:07:29,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676151 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:07:29,924::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:07:29,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706897 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:07:39,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:07:39,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599905 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:07:39,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:07:39,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706219 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:07:43,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef0d1d8b-ceaf-4fc2-b127-e935f1b7ad78`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:07:43,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:07:43,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706219', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599905', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:07:43,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef0d1d8b-ceaf-4fc2-b127-e935f1b7ad78`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706219', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599905', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:07:43,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef0d1d8b-ceaf-4fc2-b127-e935f1b7ad78`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:07:43,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:07:43,663::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:07:43,663::task::993::Storage.TaskManager.Task::(_decref) Task=`ef0d1d8b-ceaf-4fc2-b127-e935f1b7ad78`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:07:49,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:07:49,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679374 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:07:49,943::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:07:49,951::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631725 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:07:58,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`476061ef-a9f4-43d3-8186-b8cda5dce51a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:07:58,819::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:07:58,821::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631725', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679374', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:07:58,823::task::1191::Storage.TaskManager.Task::(prepare) Task=`476061ef-a9f4-43d3-8186-b8cda5dce51a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631725', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679374', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:07:58,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`476061ef-a9f4-43d3-8186-b8cda5dce51a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:07:58,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:07:58,826::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:07:58,827::task::993::Storage.TaskManager.Task::(_decref) Task=`476061ef-a9f4-43d3-8186-b8cda5dce51a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:07:59,827::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:07:59,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719246 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:07:59,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:07:59,960::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634441 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:08:09,839::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:08:09,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677382 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:08:09,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:08:09,970::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760914 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:08:13,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`f27ae27e-a73f-4a7f-9642-bf17ea9708fa`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:08:13,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:08:13,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760914', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677382', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:08:13,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`f27ae27e-a73f-4a7f-9642-bf17ea9708fa`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760914', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677382', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:08:13,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`f27ae27e-a73f-4a7f-9642-bf17ea9708fa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:08:13,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:08:13,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:08:13,951::task::993::Storage.TaskManager.Task::(_decref) Task=`f27ae27e-a73f-4a7f-9642-bf17ea9708fa`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:08:19,850::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:08:19,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621255 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:08:19,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:08:19,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667116 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:08:29,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4d65bd0-2521-43ef-894c-d36037ba9a99`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:08:29,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:08:29,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667116', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621255', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:08:29,137::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4d65bd0-2521-43ef-894c-d36037ba9a99`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667116', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621255', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:08:29,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4d65bd0-2521-43ef-894c-d36037ba9a99`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:08:29,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:08:29,137::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:08:29,138::task::993::Storage.TaskManager.Task::(_decref) Task=`b4d65bd0-2521-43ef-894c-d36037ba9a99`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:08:29,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:08:29,872::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687109 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:08:29,989::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:08:29,996::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060059 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:08:39,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:08:39,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611492 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:08:39,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:08:40,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680018 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:08:44,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`61776c99-c606-4f6a-8baf-8ed5c98b9990`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:08:44,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:08:44,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680018', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611492', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:08:44,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`61776c99-c606-4f6a-8baf-8ed5c98b9990`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680018', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611492', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:08:44,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`61776c99-c606-4f6a-8baf-8ed5c98b9990`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:08:44,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:08:44,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:08:44,260::task::993::Storage.TaskManager.Task::(_decref) Task=`61776c99-c606-4f6a-8baf-8ed5c98b9990`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:08:49,887::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:08:49,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656839 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:08:50,008::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:08:50,016::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061782 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:08:59,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e68c243-0a03-45ba-8bcd-6c12ec63c30f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:08:59,372::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:08:59,373::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061782', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656839', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:08:59,373::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e68c243-0a03-45ba-8bcd-6c12ec63c30f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061782', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656839', 'lastCheck': '9.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:08:59,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e68c243-0a03-45ba-8bcd-6c12ec63c30f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:08:59,373::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:08:59,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:08:59,374::task::993::Storage.TaskManager.Task::(_decref) Task=`0e68c243-0a03-45ba-8bcd-6c12ec63c30f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:08:59,898::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:08:59,899::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:08:59,899::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:08:59,907::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00062849 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:08:59,908::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00062849 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:08:59,908::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:08:59,908::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:08:59,908::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:08:59,909::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:08:59,909::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:08:59,909::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:08:59,909::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:08:59,909::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:08:59,910::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:00,017::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:09:00,018::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:09:00,018::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:00,027::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000602919 s, 3.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:00,027::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000602919 s, 3.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:09:00,028::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:09:00,028::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:09:00,028::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:09:00,028::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 18:09:00,158::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:09:00,159::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:09:00,159::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 18:09:00,160::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:09:00,163::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 18:09:00,164::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:09:00,165::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:09:00,166::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:09:00,166::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:09:00,168::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:00,169::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:09:00,178::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:09:00,178::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:09:00,337::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:09:00,337::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:09:00,346::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596484 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:00,356::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:00,357::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:09:00,357::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:09:00,358::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:09:00,358::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:09:00,358::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:09:00,359::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:00,525::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:00,525::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:00,533::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588806 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:09:10,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:09:10,358::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644815 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:10,535::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:10,544::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659489 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:09:14,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`026dbf77-e2c5-4142-8976-e4558f387b52`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:09:14,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:09:14,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659489', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644815', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:09:14,515::task::1191::Storage.TaskManager.Task::(prepare) Task=`026dbf77-e2c5-4142-8976-e4558f387b52`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659489', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644815', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:09:14,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`026dbf77-e2c5-4142-8976-e4558f387b52`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:09:14,516::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:09:14,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:09:14,516::task::993::Storage.TaskManager.Task::(_decref) Task=`026dbf77-e2c5-4142-8976-e4558f387b52`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:09:20,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:09:20,370::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011971 s, 3.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:20,545::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:20,553::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581711 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:09:29,629::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac50b2fe-7aa7-4ea2-83c6-c460941d8ad6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:09:29,629::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:09:29,630::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581711', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011971', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:09:29,630::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac50b2fe-7aa7-4ea2-83c6-c460941d8ad6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581711', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011971', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:09:29,630::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac50b2fe-7aa7-4ea2-83c6-c460941d8ad6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:09:29,630::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:09:29,630::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:09:29,631::task::993::Storage.TaskManager.Task::(_decref) Task=`ac50b2fe-7aa7-4ea2-83c6-c460941d8ad6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:09:30,374::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:09:30,383::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000812901 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:30,554::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:30,562::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756886 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:09:40,387::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:09:40,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621392 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:40,563::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:40,572::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552372 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:09:44,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`591dfb43-5477-4d41-95ed-d718fad9e5b1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:09:44,735::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:09:44,736::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552372', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621392', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:09:44,736::task::1191::Storage.TaskManager.Task::(prepare) Task=`591dfb43-5477-4d41-95ed-d718fad9e5b1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552372', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621392', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:09:44,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`591dfb43-5477-4d41-95ed-d718fad9e5b1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:09:44,736::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:09:44,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:09:44,737::task::993::Storage.TaskManager.Task::(_decref) Task=`591dfb43-5477-4d41-95ed-d718fad9e5b1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:09:50,404::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:09:50,413::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649156 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:09:50,574::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:09:50,581::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616968 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:09:59,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`62ace026-ab10-493e-941e-b3034f5e1c5d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:09:59,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:09:59,838::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616968', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649156', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:09:59,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`62ace026-ab10-493e-941e-b3034f5e1c5d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616968', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649156', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:09:59,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`62ace026-ab10-493e-941e-b3034f5e1c5d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:09:59,839::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:09:59,839::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:09:59,839::task::993::Storage.TaskManager.Task::(_decref) Task=`62ace026-ab10-493e-941e-b3034f5e1c5d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:10:00,417::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:10:00,426::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689585 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:10:00,583::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:10:00,591::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688739 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:10:10,429::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:10:10,439::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756364 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:10:10,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:10:10,601::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000839343 s, 4.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:10:14,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`034a6612-359d-40d9-af1c-88a52ef6e301`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:10:14,951::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:10:14,951::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839343', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756364', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:10:14,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`034a6612-359d-40d9-af1c-88a52ef6e301`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839343', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756364', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:10:14,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`034a6612-359d-40d9-af1c-88a52ef6e301`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:10:14,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:10:14,952::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:10:14,952::task::993::Storage.TaskManager.Task::(_decref) Task=`034a6612-359d-40d9-af1c-88a52ef6e301`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:10:20,442::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:10:20,451::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00116671 s, 3.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:10:20,602::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:10:20,610::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580324 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:10:30,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1a82193-4573-419d-a13c-f8ae3cfeebd3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:10:30,088::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:10:30,088::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580324', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116671', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:10:30,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1a82193-4573-419d-a13c-f8ae3cfeebd3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580324', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116671', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:10:30,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1a82193-4573-419d-a13c-f8ae3cfeebd3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:10:30,089::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:10:30,089::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:10:30,089::task::993::Storage.TaskManager.Task::(_decref) Task=`b1a82193-4573-419d-a13c-f8ae3cfeebd3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:10:30,455::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:10:30,464::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660086 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:10:30,612::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:10:30,619::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646338 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:10:40,467::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:10:40,475::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609911 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:10:40,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:10:40,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753801 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:10:45,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b43e27b-03c5-4cab-916c-4dde20628bb1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:10:45,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:10:45,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753801', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609911', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:10:45,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b43e27b-03c5-4cab-916c-4dde20628bb1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753801', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609911', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:10:45,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b43e27b-03c5-4cab-916c-4dde20628bb1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:10:45,198::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:10:45,198::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:10:45,198::task::993::Storage.TaskManager.Task::(_decref) Task=`7b43e27b-03c5-4cab-916c-4dde20628bb1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:10:50,479::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:10:50,488::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629574 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:10:50,636::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:10:50,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643179 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:11:00,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`e757af3f-d684-4f29-8393-1a3280a876c0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:11:00,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:11:00,309::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643179', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629574', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:11:00,309::task::1191::Storage.TaskManager.Task::(prepare) Task=`e757af3f-d684-4f29-8393-1a3280a876c0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643179', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629574', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:11:00,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`e757af3f-d684-4f29-8393-1a3280a876c0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:11:00,309::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:11:00,310::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:11:00,310::task::993::Storage.TaskManager.Task::(_decref) Task=`e757af3f-d684-4f29-8393-1a3280a876c0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:11:00,491::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:11:00,499::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737419 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:11:00,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:11:00,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712955 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:11:03,227::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4cc85ab6] >Thread-15::DEBUG::2014-08-12 18:11:03,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`b73edb13-9be8-41f3-af1b-2b8f476eae94`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:11:03,229::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 18:11:03,231::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 18:11:03,232::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 18:11:08,301::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 18:11:08,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,308::__init__::225::IOProcess::(_processLogs) (169) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:11:08,308::__init__::225::IOProcess::(_processLogs) (169) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:11:08,308::__init__::225::IOProcess::(_processLogs) (169) Building response >Thread-29::DEBUG::2014-08-12 18:11:08,308::__init__::225::IOProcess::(_processLogs) (169) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,308::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,308::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:11:08,335::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:11:08,336::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:11:08,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,336::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,336::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,336::__init__::225::IOProcess::(_processLogs) (170) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:11:08,337::__init__::225::IOProcess::(_processLogs) (170) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:11:08,337::__init__::225::IOProcess::(_processLogs) (170) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,338::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 18:11:08,338::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0adb6530-ef5f-41f0-8655-a7ca83123c87',) >Thread-15::DEBUG::2014-08-12 18:11:08,338::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 18:11:08,339::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 18:11:08,339::task::1191::Storage.TaskManager.Task::(prepare) Task=`b73edb13-9be8-41f3-af1b-2b8f476eae94`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 18:11:08,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`b73edb13-9be8-41f3-af1b-2b8f476eae94`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:11:08,339::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:11:08,339::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:11:08,340::task::993::Storage.TaskManager.Task::(_decref) Task=`b73edb13-9be8-41f3-af1b-2b8f476eae94`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:11:08,349::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4cc85ab6] >Thread-15::DEBUG::2014-08-12 18:11:08,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e071473-12b1-4313-8a2c-d2819532d1ad`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:11:08,349::logUtils::44::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='0adb6530-ef5f-41f0-8655-a7ca83123c87', autoDetach=False, options=None) >Thread-15::DEBUG::2014-08-12 18:11:08,349::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:11:08,350::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:11:08,350::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:11:08,350::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:11:08,373::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:11:08,374::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:11:08,472::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:11:08,474::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87`ReqID=`f360505c-b6ed-4184-9900-4b5389fb6a19`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2741' at 'formatStorageDomain' >Thread-15::DEBUG::2014-08-12 18:11:08,474::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 18:11:08,474::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 18:11:08,474::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87`ReqID=`f360505c-b6ed-4184-9900-4b5389fb6a19`::Granted request >Thread-15::DEBUG::2014-08-12 18:11:08,475::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5e071473-12b1-4313-8a2c-d2819532d1ad`::_resourcesAcquired: Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87 (exclusive) >Thread-15::DEBUG::2014-08-12 18:11:08,475::task::993::Storage.TaskManager.Task::(_decref) Task=`5e071473-12b1-4313-8a2c-d2819532d1ad`::ref 1 aborting False >Thread-15::DEBUG::2014-08-12 18:11:08,475::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:11:08,475::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:11:08,475::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:11:08,475::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:11:08,476::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:11:08,476::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:11:08,497::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:11:08,505::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:11:08,547::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:11:08,547::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,547::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,548::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,548::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,548::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,548::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,549::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-29::DEBUG::2014-08-12 18:11:08,550::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:11:08,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,550::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,551::__init__::225::IOProcess::(_processLogs) (171) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:11:08,551::__init__::225::IOProcess::(_processLogs) (171) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:11:08,551::__init__::225::IOProcess::(_processLogs) (171) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,553::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,554::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 18:11:08,557::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 18:11:08,557::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 18:11:08,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,558::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,558::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,558::__init__::225::IOProcess::(_processLogs) (172) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 18:11:08,558::__init__::225::IOProcess::(_processLogs) (172) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 18:11:08,559::__init__::225::IOProcess::(_processLogs) (172) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:11:08,560::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 18:11:08,560::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,562::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:11:08,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,562::__init__::225::IOProcess::(_processLogs) (173) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:11:08,563::__init__::225::IOProcess::(_processLogs) (173) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 18:11:08,600::__init__::225::IOProcess::(_processLogs) (173) Queuing response >Thread-15::DEBUG::2014-08-12 18:11:08,600::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=674aee93c8b731bf0e42767249a6c48454b08d0e'] >Thread-29::DEBUG::2014-08-12 18:11:08,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,602::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 18:11:08,603::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 18:11:08,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,604::__init__::225::IOProcess::(_processLogs) (174) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:11:08,604::__init__::225::IOProcess::(_processLogs) (174) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:11:08,605::__init__::225::IOProcess::(_processLogs) (174) Building response >Thread-29::DEBUG::2014-08-12 18:11:08,605::__init__::225::IOProcess::(_processLogs) (174) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,605::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,605::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 18:11:08,605::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,606::__init__::225::IOProcess::(_processLogs) (175) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:11:08,606::__init__::225::IOProcess::(_processLogs) (175) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 18:11:08,607::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 18:11:08,607::__init__::225::IOProcess::(_processLogs) (175) Queuing response >Thread-15::INFO::2014-08-12 18:11:08,607::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_imageNS already registered >Thread-29::DEBUG::2014-08-12 18:11:08,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 18:11:08,608::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0adb6530-ef5f-41f0-8655-a7ca83123c87_volumeNS already registered >Thread-29::DEBUG::2014-08-12 18:11:08,609::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:11:08,610::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:11:08,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,610::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,611::__init__::225::IOProcess::(_processLogs) (176) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:11:08,611::__init__::225::IOProcess::(_processLogs) (176) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 18:11:08,611::__init__::225::IOProcess::(_processLogs) (176) Queuing response >Thread-15::DEBUG::2014-08-12 18:11:08,612::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0adb6530-ef5f-41f0-8655-a7ca83123c87', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=674aee93c8b731bf0e42767249a6c48454b08d0e'] >Thread-29::DEBUG::2014-08-12 18:11:08,612::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-15::INFO::2014-08-12 18:11:08,613::fileSD::508::Storage.StorageDomain::(format) Formatting domain 0adb6530-ef5f-41f0-8655-a7ca83123c87 >Thread-29::DEBUG::2014-08-12 18:11:08,614::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:11:08,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,615::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,615::__init__::225::IOProcess::(_processLogs) (177) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:11:08,616::__init__::225::IOProcess::(_processLogs) (177) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:11:08,618::__init__::225::IOProcess::(_processLogs) (177) Building response >Thread-29::DEBUG::2014-08-12 18:11:08,619::__init__::225::IOProcess::(_processLogs) (177) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,622::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-29::DEBUG::2014-08-12 18:11:08,624::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:11:08,624::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,625::__init__::225::IOProcess::(_processLogs) (178) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 18:11:08,625::__init__::225::IOProcess::(_processLogs) (178) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 18:11:08,626::__init__::225::IOProcess::(_processLogs) (178) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,626::__init__::225::IOProcess::(_processLogs) Sending response sized 101 >Thread-29::DEBUG::2014-08-12 18:11:08,627::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 18:11:08,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,627::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,627::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,628::__init__::225::IOProcess::(_processLogs) (179) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:11:08,628::__init__::225::IOProcess::(_processLogs) (179) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:11:08,628::__init__::225::IOProcess::(_processLogs) (179) Building response >Thread-29::DEBUG::2014-08-12 18:11:08,628::__init__::225::IOProcess::(_processLogs) (179) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,628::__init__::225::IOProcess::(_processLogs) Sending response sized 314 >Thread-29::DEBUG::2014-08-12 18:11:08,629::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 18:11:08,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,630::__init__::225::IOProcess::(_processLogs) (180) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 18:11:08,630::__init__::225::IOProcess::(_processLogs) (180) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 18:11:08,631::__init__::225::IOProcess::(_processLogs) (180) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,631::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,631::__init__::225::IOProcess::(_processLogs) Sending response sized 141 >Thread-29::DEBUG::2014-08-12 18:11:08,632::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 18:11:08,633::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,633::__init__::225::IOProcess::(_processLogs) (181) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:11:08,634::__init__::225::IOProcess::(_processLogs) (181) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:11:08,634::__init__::225::IOProcess::(_processLogs) (181) Building response >Thread-29::DEBUG::2014-08-12 18:11:08,634::__init__::225::IOProcess::(_processLogs) (181) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,634::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 18:11:08,635::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-29::DEBUG::2014-08-12 18:11:08,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,635::__init__::225::IOProcess::(_processLogs) (182) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:11:08,635::__init__::225::IOProcess::(_processLogs) (182) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:11:08,636::__init__::225::IOProcess::(_processLogs) (182) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,636::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,637::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 18:11:08,637::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,637::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,638::__init__::225::IOProcess::(_processLogs) (183) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:11:08,638::__init__::225::IOProcess::(_processLogs) (183) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:11:08,639::__init__::225::IOProcess::(_processLogs) (183) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,639::__init__::225::IOProcess::(_processLogs) Sending response sized 319 >Thread-29::DEBUG::2014-08-12 18:11:08,639::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 18:11:08,640::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,640::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,640::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,640::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,640::__init__::225::IOProcess::(_processLogs) (184) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:11:08,640::__init__::225::IOProcess::(_processLogs) (184) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:11:08,641::__init__::225::IOProcess::(_processLogs) (184) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,641::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,641::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,642::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 18:11:08,642::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,643::__init__::225::IOProcess::(_processLogs) (185) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:11:08,643::__init__::225::IOProcess::(_processLogs) (185) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:11:08,643::__init__::225::IOProcess::(_processLogs) (185) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,644::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,644::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 18:11:08,644::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 18:11:08,645::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,645::__init__::225::IOProcess::(_processLogs) (186) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:11:08,645::__init__::225::IOProcess::(_processLogs) (186) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:11:08,646::__init__::225::IOProcess::(_processLogs) (186) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,646::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,647::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 18:11:08,647::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,647::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,647::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,647::__init__::225::IOProcess::(_processLogs) (187) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:11:08,648::__init__::225::IOProcess::(_processLogs) (187) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:11:08,648::__init__::225::IOProcess::(_processLogs) (187) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,649::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 18:11:08,649::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 18:11:08,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,650::__init__::225::IOProcess::(_processLogs) (188) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:11:08,650::__init__::225::IOProcess::(_processLogs) (188) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:11:08,651::__init__::225::IOProcess::(_processLogs) (188) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,651::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,652::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 18:11:08,652::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:11:08,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,652::__init__::225::IOProcess::(_processLogs) (189) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:11:08,653::__init__::225::IOProcess::(_processLogs) (189) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:11:08,653::__init__::225::IOProcess::(_processLogs) (189) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,654::__init__::225::IOProcess::(_processLogs) Sending response sized 315 >Thread-29::DEBUG::2014-08-12 18:11:08,654::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-29::DEBUG::2014-08-12 18:11:08,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,655::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,655::__init__::225::IOProcess::(_processLogs) (190) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:11:08,655::__init__::225::IOProcess::(_processLogs) (190) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:11:08,656::__init__::225::IOProcess::(_processLogs) (190) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,656::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,656::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,656::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 18:11:08,657::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,657::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,657::__init__::225::IOProcess::(_processLogs) (191) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 18:11:08,657::__init__::225::IOProcess::(_processLogs) (191) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 18:11:08,658::__init__::225::IOProcess::(_processLogs) (191) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,658::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,659::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 18:11:08,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,660::__init__::225::IOProcess::(_processLogs) (192) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:11:08,660::__init__::225::IOProcess::(_processLogs) (192) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:11:08,660::__init__::225::IOProcess::(_processLogs) (192) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,661::__init__::225::IOProcess::(_processLogs) Sending response sized 315 >Thread-29::DEBUG::2014-08-12 18:11:08,661::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 18:11:08,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,662::__init__::225::IOProcess::(_processLogs) (193) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 18:11:08,662::__init__::225::IOProcess::(_processLogs) (193) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 18:11:08,662::__init__::225::IOProcess::(_processLogs) (193) Building response >Thread-29::DEBUG::2014-08-12 18:11:08,663::__init__::225::IOProcess::(_processLogs) (193) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,663::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:11:08,664::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 18:11:08,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,664::__init__::225::IOProcess::(_processLogs) (194) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 18:11:08,665::__init__::225::IOProcess::(_processLogs) (194) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 18:11:08,665::__init__::225::IOProcess::(_processLogs) (194) Building response >Thread-29::DEBUG::2014-08-12 18:11:08,665::__init__::225::IOProcess::(_processLogs) (194) Queuing response >Thread-29::DEBUG::2014-08-12 18:11:08,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:11:08,666::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:11:08,666::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-29::DEBUG::2014-08-12 18:11:08,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:11:08,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:11:08,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:11:08,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:11:08,667::__init__::225::IOProcess::(_processLogs) (195) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 18:11:08,667::__init__::225::IOProcess::(_processLogs) (195) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 18:11:08,667::__init__::225::IOProcess::(_processLogs) (195) Queuing response >Thread-15::INFO::2014-08-12 18:11:08,668::logUtils::47::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-29::DEBUG::2014-08-12 18:11:08,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:11:08,669::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e071473-12b1-4313-8a2c-d2819532d1ad`::finished: None >Thread-15::DEBUG::2014-08-12 18:11:08,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e071473-12b1-4313-8a2c-d2819532d1ad`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 18:11:08,670::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:11:08,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87': < ResourceRef 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 18:11:08,671::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:11:08,671::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' >Thread-15::DEBUG::2014-08-12 18:11:08,671::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' (0 active users) >Thread-15::DEBUG::2014-08-12 18:11:08,671::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:11:08,671::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0adb6530-ef5f-41f0-8655-a7ca83123c87', Clearing records. >Thread-15::DEBUG::2014-08-12 18:11:08,672::task::993::Storage.TaskManager.Task::(_decref) Task=`5e071473-12b1-4313-8a2c-d2819532d1ad`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:11:08,723::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [3900bf23] >Thread-15::DEBUG::2014-08-12 18:11:08,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5ff3f8a-ecbc-4979-b7a0-ebf3be126b37`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:11:08,724::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '17574304-89f2-4030-bb03-38db6f295035'}], options=None) >Thread-15::DEBUG::2014-08-12 18:11:08,724::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 18:11:08,759::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:11:08,759::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:11:08,759::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:11:08,759::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:11:08,760::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:11:08,760::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:11:08,780::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:11:08,781::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:11:08,826::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:11:08,826::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,827::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,827::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,827::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,828::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,828::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:11:08,828::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 18:11:08,828::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 18:11:08,828::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5ff3f8a-ecbc-4979-b7a0-ebf3be126b37`::finished: {'statuslist': [{'status': 0, 'id': '17574304-89f2-4030-bb03-38db6f295035'}]} >Thread-15::DEBUG::2014-08-12 18:11:08,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5ff3f8a-ecbc-4979-b7a0-ebf3be126b37`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:11:08,829::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:11:08,829::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:11:08,829::task::993::Storage.TaskManager.Task::(_decref) Task=`b5ff3f8a-ecbc-4979-b7a0-ebf3be126b37`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:11:10,502::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:11:10,505::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:11:10,655::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-16::DEBUG::2014-08-12 18:11:10,656::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:11:10,781::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:11:10,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:11:10,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614074 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:11:10,836::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:11:10,837::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:11:10,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:11:10,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685252 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:11:15,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`37d73b7d-a19e-4752-870f-9d4fc0526c3c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:11:15,418::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:11:15,419::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685252', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614074', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:11:15,419::task::1191::Storage.TaskManager.Task::(prepare) Task=`37d73b7d-a19e-4752-870f-9d4fc0526c3c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685252', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614074', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:11:15,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`37d73b7d-a19e-4752-870f-9d4fc0526c3c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:11:15,419::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:11:15,419::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:11:15,419::task::993::Storage.TaskManager.Task::(_decref) Task=`37d73b7d-a19e-4752-870f-9d4fc0526c3c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:11:20,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:11:20,807::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618916 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:11:20,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:11:20,856::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000534341 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:11:30,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`b484d98b-dbf7-4c1e-bdfb-7a08b1a976b7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:11:30,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:11:30,525::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534341', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618916', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:11:30,526::task::1191::Storage.TaskManager.Task::(prepare) Task=`b484d98b-dbf7-4c1e-bdfb-7a08b1a976b7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534341', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618916', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:11:30,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`b484d98b-dbf7-4c1e-bdfb-7a08b1a976b7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:11:30,526::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:11:30,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:11:30,526::task::993::Storage.TaskManager.Task::(_decref) Task=`b484d98b-dbf7-4c1e-bdfb-7a08b1a976b7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:11:30,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:11:30,820::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636724 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:11:30,857::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:11:30,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071898 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:11:40,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:11:40,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057991 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:11:40,867::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:11:40,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718415 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:11:45,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`0143c39c-8269-4b15-82fc-bc115947b1dd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:11:45,638::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:11:45,638::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718415', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057991', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:11:45,638::task::1191::Storage.TaskManager.Task::(prepare) Task=`0143c39c-8269-4b15-82fc-bc115947b1dd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718415', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057991', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:11:45,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`0143c39c-8269-4b15-82fc-bc115947b1dd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:11:45,639::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:11:45,639::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:11:45,639::task::993::Storage.TaskManager.Task::(_decref) Task=`0143c39c-8269-4b15-82fc-bc115947b1dd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:11:50,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:11:50,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622664 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:11:50,877::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:11:50,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623936 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:12:00,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`547f8ad4-cbcc-4a1e-934a-157856679af7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:12:00,746::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:12:00,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623936', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622664', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:12:00,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`547f8ad4-cbcc-4a1e-934a-157856679af7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623936', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622664', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:12:00,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`547f8ad4-cbcc-4a1e-934a-157856679af7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:12:00,746::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:12:00,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:12:00,747::task::993::Storage.TaskManager.Task::(_decref) Task=`547f8ad4-cbcc-4a1e-934a-157856679af7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:12:00,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:12:00,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617208 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:12:00,886::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:12:00,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711181 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:12:10,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:12:10,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603819 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:12:10,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:12:10,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740821 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:12:15,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`951c884a-ead4-4321-a421-f76673ebb7f1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:12:15,873::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:12:15,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740821', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603819', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:12:15,873::task::1191::Storage.TaskManager.Task::(prepare) Task=`951c884a-ead4-4321-a421-f76673ebb7f1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740821', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603819', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:12:15,873::task::595::Storage.TaskManager.Task::(_updateState) Task=`951c884a-ead4-4321-a421-f76673ebb7f1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:12:15,873::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:12:15,873::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:12:15,874::task::993::Storage.TaskManager.Task::(_decref) Task=`951c884a-ead4-4321-a421-f76673ebb7f1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:12:20,870::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:12:20,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621762 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:12:20,905::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:12:20,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000584348 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:12:30,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:12:30,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637539 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:12:30,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:12:30,921::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059966 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:12:30,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ecf499b-ac62-44fe-9fb1-d0bc389bd859`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:12:30,977::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:12:30,977::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059966', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637539', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:12:30,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ecf499b-ac62-44fe-9fb1-d0bc389bd859`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059966', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637539', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:12:30,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ecf499b-ac62-44fe-9fb1-d0bc389bd859`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:12:30,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:12:30,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:12:30,978::task::993::Storage.TaskManager.Task::(_decref) Task=`0ecf499b-ac62-44fe-9fb1-d0bc389bd859`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:12:40,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:12:40,915::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567974 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:12:40,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:12:40,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601867 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:12:43,937::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [36bfbb12] >Thread-15::DEBUG::2014-08-12 18:12:43,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`eee61666-4d49-4903-be0d-a4a9afff97f5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:12:43,938::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'iqn': '', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'mnt_options': 'vers=4.1', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) >Thread-15::DEBUG::2014-08-12 18:12:43,940::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 18:12:43,941::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=7,nfsvers=3,vers=4.1 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::ERROR::2014-08-12 18:12:43,980::storageServer::211::Storage.StorageServer.MountConnection::(connect) Mount failed: (32, ';mount.nfs: Protocol not supported\n') >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storageServer.py", line 209, in connect > self._mount.mount(self.options, self._vfsType) > File "/usr/share/vdsm/storage/mount.py", line 198, in mount > return self._runcmd(cmd, timeout) > File "/usr/share/vdsm/storage/mount.py", line 214, in _runcmd > raise MountError(rc, ";".join((out, err))) >MountError: (32, ';mount.nfs: Protocol not supported\n') >Thread-15::ERROR::2014-08-12 18:12:43,995::hsm::2427::Storage.HSM::(connectStorageServer) Could not connect to storageServer >Traceback (most recent call last): > File "/usr/share/vdsm/storage/hsm.py", line 2424, in connectStorageServer > conObj.connect() > File "/usr/share/vdsm/storage/storageServer.py", line 328, in connect > return self._mountCon.connect() > File "/usr/share/vdsm/storage/storageServer.py", line 217, in connect > raise e >MountError: (32, ';mount.nfs: Protocol not supported\n') >Thread-15::DEBUG::2014-08-12 18:12:43,997::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 18:12:43,997::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 477, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-08-12 18:12:43,997::task::1191::Storage.TaskManager.Task::(prepare) Task=`eee61666-4d49-4903-be0d-a4a9afff97f5`::finished: {'statuslist': [{'status': 477, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-08-12 18:12:43,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`eee61666-4d49-4903-be0d-a4a9afff97f5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:12:43,997::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:12:43,997::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:12:43,998::task::993::Storage.TaskManager.Task::(_decref) Task=`eee61666-4d49-4903-be0d-a4a9afff97f5`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:12:46,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`559cd08c-3038-4a58-a6c5-65ad3895f0cc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:12:46,128::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:12:46,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601867', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567974', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:12:46,131::task::1191::Storage.TaskManager.Task::(prepare) Task=`559cd08c-3038-4a58-a6c5-65ad3895f0cc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601867', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567974', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:12:46,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`559cd08c-3038-4a58-a6c5-65ad3895f0cc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:12:46,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:12:46,132::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:12:46,132::task::993::Storage.TaskManager.Task::(_decref) Task=`559cd08c-3038-4a58-a6c5-65ad3895f0cc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:12:50,919::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:12:50,928::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612793 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:12:50,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:12:50,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607047 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:13:00,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:13:00,939::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700157 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:13:00,943::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:13:00,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548129 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:13:01,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d837925-d2af-45cb-a79c-b78ff1800a40`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:01,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:13:01,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548129', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700157', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:13:01,260::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d837925-d2af-45cb-a79c-b78ff1800a40`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548129', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700157', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:13:01,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d837925-d2af-45cb-a79c-b78ff1800a40`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:13:01,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:01,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:01,260::task::993::Storage.TaskManager.Task::(_decref) Task=`8d837925-d2af-45cb-a79c-b78ff1800a40`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:13:10,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:13:10,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:13:10,971::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654674 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:13:10,973::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061131 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:13:16,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a07e9e0-9134-4768-aeda-d38473218ee7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:16,363::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:13:16,364::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654674', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061131', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:13:16,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a07e9e0-9134-4768-aeda-d38473218ee7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654674', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061131', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:13:16,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a07e9e0-9134-4768-aeda-d38473218ee7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:13:16,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:16,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:16,365::task::993::Storage.TaskManager.Task::(_decref) Task=`2a07e9e0-9134-4768-aeda-d38473218ee7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:13:20,974::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:13:20,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:13:20,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604685 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:13:20,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602164 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:13:30,994::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:13:31,004::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:13:31,004::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649384 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:13:31,016::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695978 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:13:31,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`57980e3e-37d5-44d3-8f24-ae2650247e0c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:31,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:13:31,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649384', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695978', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:13:31,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`57980e3e-37d5-44d3-8f24-ae2650247e0c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649384', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695978', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:13:31,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`57980e3e-37d5-44d3-8f24-ae2650247e0c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:13:31,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:31,475::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:31,476::task::993::Storage.TaskManager.Task::(_decref) Task=`57980e3e-37d5-44d3-8f24-ae2650247e0c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:13:41,018::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:13:41,028::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000565788 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:13:41,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:13:41,039::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00055735 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:13:46,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`b300aebc-674f-421d-923b-e4ed43b992ec`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:46,581::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:13:46,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565788', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055735', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:13:46,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`b300aebc-674f-421d-923b-e4ed43b992ec`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565788', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055735', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:13:46,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`b300aebc-674f-421d-923b-e4ed43b992ec`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:13:46,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:46,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:46,582::task::993::Storage.TaskManager.Task::(_decref) Task=`b300aebc-674f-421d-923b-e4ed43b992ec`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:13:50,746::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [10afa7da] >Thread-15::DEBUG::2014-08-12 18:13:50,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe3c90f5-39dc-4270-a182-c3efddcbf468`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:50,747::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) >Thread-15::DEBUG::2014-08-12 18:13:50,749::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 18:13:50,749::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=7,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 18:13:50,791::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 18:13:50,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:50,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:50,792::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:50,792::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:50,792::__init__::225::IOProcess::(_processLogs) (196) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:13:50,792::__init__::225::IOProcess::(_processLogs) (196) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:13:50,793::__init__::225::IOProcess::(_processLogs) (196) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:50,793::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:13:50,807::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:13:50,807::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:13:50,807::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:50,807::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:50,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:50,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:50,808::__init__::225::IOProcess::(_processLogs) (197) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:13:50,808::__init__::225::IOProcess::(_processLogs) (197) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 18:13:50,809::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-29::DEBUG::2014-08-12 18:13:50,809::__init__::225::IOProcess::(_processLogs) (197) Queuing response >Thread-15::DEBUG::2014-08-12 18:13:50,809::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 18:13:50,810::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-29::DEBUG::2014-08-12 18:13:50,810::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:13:50,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe3c90f5-39dc-4270-a182-c3efddcbf468`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-08-12 18:13:50,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe3c90f5-39dc-4270-a182-c3efddcbf468`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 18:13:50,811::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 18:13:50,812::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:50,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:50,812::task::993::Storage.TaskManager.Task::(_decref) Task=`fe3c90f5-39dc-4270-a182-c3efddcbf468`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:13:50,928::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [3c6ffe75] >Thread-15::DEBUG::2014-08-12 18:13:50,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75e1341-92bc-4661-aafa-87ea982e0d2c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:50,929::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:13:50,931::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:13:50,932::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:13:50,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:50,932::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:50,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:50,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:50,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:50,932::__init__::225::IOProcess::(_processLogs) (198) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:13:50,933::__init__::225::IOProcess::(_processLogs) (198) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 18:13:50,933::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-29::DEBUG::2014-08-12 18:13:50,933::__init__::225::IOProcess::(_processLogs) (198) Queuing response >Thread-15::DEBUG::2014-08-12 18:13:50,934::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 18:13:50,934::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-29::DEBUG::2014-08-12 18:13:50,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:13:50,935::task::1191::Storage.TaskManager.Task::(prepare) Task=`f75e1341-92bc-4661-aafa-87ea982e0d2c`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:13:50,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75e1341-92bc-4661-aafa-87ea982e0d2c`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 18:13:50,935::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 18:13:50,936::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:50,936::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:50,936::task::993::Storage.TaskManager.Task::(_decref) Task=`f75e1341-92bc-4661-aafa-87ea982e0d2c`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:13:50,945::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [3c6ffe75] >Thread-15::DEBUG::2014-08-12 18:13:50,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8dab722-5c20-4e60-ba9a-87b0f80f22aa`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:50,945::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='880b1e00-85c8-4296-8d02-a32c1d378a1f', domainName='pNFS', typeSpecificArg='netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', domClass=1, domVersion='3', options=None) >Thread-15::DEBUG::2014-08-12 18:13:50,946::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:13:50,946::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:13:50,946::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:13:50,946::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:13:50,946::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:13:50,946::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:13:50,976::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:13:50,977::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-16::DEBUG::2014-08-12 18:13:51,039::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:13:51,050::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605639 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:13:51,050::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:13:51,060::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000547825 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:13:51,063::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:13:51,065::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,068::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,069::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,070::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,071::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,072::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,072::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::ERROR::2014-08-12 18:13:51,072::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-15::ERROR::2014-08-12 18:13:51,072::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-15::DEBUG::2014-08-12 18:13:51,072::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,076::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 880b1e00-85c8-4296-8d02-a32c1d378a1f (cwd None) >Thread-15::DEBUG::2014-08-12 18:13:51,360::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "880b1e00-85c8-4296-8d02-a32c1d378a1f" not found\n Skipping volume group 880b1e00-85c8-4296-8d02-a32c1d378a1f\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 18:13:51,365::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "880b1e00-85c8-4296-8d02-a32c1d378a1f" not found', ' Skipping volume group 880b1e00-85c8-4296-8d02-a32c1d378a1f'] >Thread-15::DEBUG::2014-08-12 18:13:51,365::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-29::DEBUG::2014-08-12 18:13:51,367::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:13:51,373::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,373::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-15::ERROR::2014-08-12 18:13:51,374::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 880b1e00-85c8-4296-8d02-a32c1d378a1f not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('880b1e00-85c8-4296-8d02-a32c1d378a1f',) >Thread-29::DEBUG::2014-08-12 18:13:51,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-15::INFO::2014-08-12 18:13:51,376::nfsSD::69::Storage.StorageDomain::(create) sdUUID=880b1e00-85c8-4296-8d02-a32c1d378a1f domainName=pNFS remotePath=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 domClass=1 >Thread-29::DEBUG::2014-08-12 18:13:51,377::__init__::225::IOProcess::(_processLogs) (199) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:13:51,378::__init__::225::IOProcess::(_processLogs) (199) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:13:51,379::__init__::225::IOProcess::(_processLogs) (199) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,379::__init__::225::IOProcess::(_processLogs) (199) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,380::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,382::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:13:51,384::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 18:13:51,384::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,384::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,385::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,385::__init__::225::IOProcess::(_processLogs) (200) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:13:51,385::__init__::225::IOProcess::(_processLogs) (200) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:13:51,386::__init__::225::IOProcess::(_processLogs) (200) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,386::__init__::225::IOProcess::(_processLogs) (200) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,386::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,386::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,391::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 18:13:51,391::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,392::__init__::225::IOProcess::(_processLogs) (201) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 18:13:51,392::__init__::225::IOProcess::(_processLogs) (201) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 18:13:51,392::__init__::225::IOProcess::(_processLogs) (201) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,394::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,394::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-29::DEBUG::2014-08-12 18:13:51,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,395::__init__::225::IOProcess::(_processLogs) (202) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:13:51,395::__init__::225::IOProcess::(_processLogs) (202) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:13:51,396::__init__::225::IOProcess::(_processLogs) (202) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,397::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:13:51,397::__init__::225::IOProcess::(_processLogs) Message size is 70 >Thread-29::DEBUG::2014-08-12 18:13:51,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,398::__init__::225::IOProcess::(_processLogs) (203) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,399::__init__::225::IOProcess::(_processLogs) (203) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,399::__init__::225::IOProcess::(_processLogs) (203) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,399::__init__::225::IOProcess::(_processLogs) (203) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,399::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,399::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,400::__init__::225::IOProcess::(_processLogs) Message size is 74 >Thread-29::DEBUG::2014-08-12 18:13:51,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,401::__init__::225::IOProcess::(_processLogs) (204) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,401::__init__::225::IOProcess::(_processLogs) (204) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,401::__init__::225::IOProcess::(_processLogs) (204) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,402::__init__::225::IOProcess::(_processLogs) (204) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,402::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,402::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,402::__init__::225::IOProcess::(_processLogs) Message size is 86 >Thread-29::DEBUG::2014-08-12 18:13:51,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,404::__init__::225::IOProcess::(_processLogs) (205) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,404::__init__::225::IOProcess::(_processLogs) (205) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,404::__init__::225::IOProcess::(_processLogs) (205) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,404::__init__::225::IOProcess::(_processLogs) (205) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,404::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,405::__init__::225::IOProcess::(_processLogs) Message size is 90 >Thread-29::DEBUG::2014-08-12 18:13:51,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,406::__init__::225::IOProcess::(_processLogs) (206) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,407::__init__::225::IOProcess::(_processLogs) (206) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,407::__init__::225::IOProcess::(_processLogs) (206) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,407::__init__::225::IOProcess::(_processLogs) (206) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,408::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,408::__init__::225::IOProcess::(_processLogs) Message size is 143 >Thread-29::DEBUG::2014-08-12 18:13:51,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,409::__init__::225::IOProcess::(_processLogs) (207) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,410::__init__::225::IOProcess::(_processLogs) (207) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,410::__init__::225::IOProcess::(_processLogs) (207) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,410::__init__::225::IOProcess::(_processLogs) (207) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,410::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,410::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,411::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 18:13:51,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,411::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,411::__init__::225::IOProcess::(_processLogs) (208) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,412::__init__::225::IOProcess::(_processLogs) (208) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,412::__init__::225::IOProcess::(_processLogs) (208) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,413::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,413::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 18:13:51,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,414::__init__::225::IOProcess::(_processLogs) (209) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,414::__init__::225::IOProcess::(_processLogs) (209) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,415::__init__::225::IOProcess::(_processLogs) (209) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,415::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,416::__init__::225::IOProcess::(_processLogs) Message size is 229 >Thread-29::DEBUG::2014-08-12 18:13:51,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,416::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,416::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,417::__init__::225::IOProcess::(_processLogs) (210) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 18:13:51,417::__init__::225::IOProcess::(_processLogs) (210) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 18:13:51,418::__init__::225::IOProcess::(_processLogs) (210) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,418::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,419::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-29::DEBUG::2014-08-12 18:13:51,419::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,419::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,420::__init__::225::IOProcess::(_processLogs) (211) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 18:13:51,420::__init__::225::IOProcess::(_processLogs) (211) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 18:13:51,420::__init__::225::IOProcess::(_processLogs) (211) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,421::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,421::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,421::__init__::225::IOProcess::(_processLogs) Message size is 230 >Thread-29::DEBUG::2014-08-12 18:13:51,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,422::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,422::__init__::225::IOProcess::(_processLogs) (212) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 18:13:51,422::__init__::225::IOProcess::(_processLogs) (212) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 18:13:51,423::__init__::225::IOProcess::(_processLogs) (212) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,423::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,424::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 18:13:51,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,424::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,425::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,425::__init__::225::IOProcess::(_processLogs) (213) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 18:13:51,425::__init__::225::IOProcess::(_processLogs) (213) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 18:13:51,425::__init__::225::IOProcess::(_processLogs) (213) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,426::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,426::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,426::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-29::DEBUG::2014-08-12 18:13:51,426::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,427::__init__::225::IOProcess::(_processLogs) (214) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 18:13:51,427::__init__::225::IOProcess::(_processLogs) (214) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 18:13:51,428::__init__::225::IOProcess::(_processLogs) (214) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,428::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,429::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 18:13:51,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,429::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,429::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,430::__init__::225::IOProcess::(_processLogs) (215) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 18:13:51,430::__init__::225::IOProcess::(_processLogs) (215) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 18:13:51,430::__init__::225::IOProcess::(_processLogs) (215) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,431::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,431::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,431::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-29::DEBUG::2014-08-12 18:13:51,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,432::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,432::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,432::__init__::225::IOProcess::(_processLogs) (216) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 18:13:51,432::__init__::225::IOProcess::(_processLogs) (216) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 18:13:51,433::__init__::225::IOProcess::(_processLogs) (216) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,433::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,434::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-29::DEBUG::2014-08-12 18:13:51,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,434::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,434::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,434::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,435::__init__::225::IOProcess::(_processLogs) (217) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 18:13:51,435::__init__::225::IOProcess::(_processLogs) (217) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 18:13:51,435::__init__::225::IOProcess::(_processLogs) (217) Queuing response >Thread-15::DEBUG::2014-08-12 18:13:51,436::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 18:13:51,436::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,438::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,438::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:13:51,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-15::DEBUG::2014-08-12 18:13:51,439::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-29::DEBUG::2014-08-12 18:13:51,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-15::DEBUG::2014-08-12 18:13:51,440::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-29::DEBUG::2014-08-12 18:13:51,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-15::DEBUG::2014-08-12 18:13:51,441::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-29::DEBUG::2014-08-12 18:13:51,442::__init__::225::IOProcess::(_processLogs) (218) Finding callback 'readfile'... >Thread-15::DEBUG::2014-08-12 18:13:51,442::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-29::DEBUG::2014-08-12 18:13:51,443::__init__::225::IOProcess::(_processLogs) (218) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 18:13:51,444::__init__::225::IOProcess::(_processLogs) (218) Building response >Thread-15::DEBUG::2014-08-12 18:13:51,444::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=880b1e00-85c8-4296-8d02-a32c1d378a1f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1f1e3d618d088808e2d3fa469a341ea67efd863e'] >Thread-29::DEBUG::2014-08-12 18:13:51,445::__init__::225::IOProcess::(_processLogs) (218) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,446::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,446::__init__::225::IOProcess::(_processLogs) Sending response sized 93 >Thread-29::DEBUG::2014-08-12 18:13:51,446::__init__::225::IOProcess::(_processLogs) Message size is 644 >Thread-29::DEBUG::2014-08-12 18:13:51,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,446::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,447::__init__::225::IOProcess::(_processLogs) (219) Finding callback 'writefile'... >Thread-29::DEBUG::2014-08-12 18:13:51,447::__init__::225::IOProcess::(_processLogs) (219) Got request for method 'writefile' >Thread-29::DEBUG::2014-08-12 18:13:51,447::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,448::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::WARNING::2014-08-12 18:13:51,448::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-29::DEBUG::2014-08-12 18:13:51,449::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,449::__init__::225::IOProcess::(_processLogs) Message size is 333 >Thread-29::DEBUG::2014-08-12 18:13:51,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,450::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,450::__init__::225::IOProcess::(_processLogs) (220) Finding callback 'rename'... >Thread-29::DEBUG::2014-08-12 18:13:51,451::__init__::225::IOProcess::(_processLogs) (220) Got request for method 'rename' >Thread-29::DEBUG::2014-08-12 18:13:51,451::__init__::225::IOProcess::(_processLogs) DEBUG|(220) Building response >Thread-15::DEBUG::2014-08-12 18:13:51,451::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-29::DEBUG::2014-08-12 18:13:51,452::__init__::225::IOProcess::(_processLogs) (220) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,452::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,452::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,453::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,453::__init__::225::IOProcess::(_processLogs) Message size is 70 >Thread-29::DEBUG::2014-08-12 18:13:51,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,454::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,454::__init__::225::IOProcess::(_processLogs) (221) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,454::__init__::225::IOProcess::(_processLogs) (221) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,455::__init__::225::IOProcess::(_processLogs) (221) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,455::__init__::225::IOProcess::(_processLogs) (221) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,455::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,455::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,455::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,455::__init__::225::IOProcess::(_processLogs) Message size is 74 >Thread-29::DEBUG::2014-08-12 18:13:51,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,456::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,457::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,457::__init__::225::IOProcess::(_processLogs) (222) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,457::__init__::225::IOProcess::(_processLogs) (222) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,457::__init__::225::IOProcess::(_processLogs) (222) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,457::__init__::225::IOProcess::(_processLogs) (222) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,458::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,458::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,458::__init__::225::IOProcess::(_processLogs) Message size is 86 >Thread-29::DEBUG::2014-08-12 18:13:51,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,459::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,459::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,460::__init__::225::IOProcess::(_processLogs) (223) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,460::__init__::225::IOProcess::(_processLogs) (223) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,460::__init__::225::IOProcess::(_processLogs) (223) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,460::__init__::225::IOProcess::(_processLogs) (223) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,460::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,461::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,461::__init__::225::IOProcess::(_processLogs) Message size is 90 >Thread-29::DEBUG::2014-08-12 18:13:51,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,462::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,462::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,462::__init__::225::IOProcess::(_processLogs) (224) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,463::__init__::225::IOProcess::(_processLogs) (224) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,463::__init__::225::IOProcess::(_processLogs) (224) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,463::__init__::225::IOProcess::(_processLogs) (224) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,463::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,463::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,463::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,464::__init__::225::IOProcess::(_processLogs) Message size is 143 >Thread-29::DEBUG::2014-08-12 18:13:51,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,464::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,465::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,465::__init__::225::IOProcess::(_processLogs) (225) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,465::__init__::225::IOProcess::(_processLogs) (225) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,465::__init__::225::IOProcess::(_processLogs) (225) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,465::__init__::225::IOProcess::(_processLogs) (225) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,466::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,466::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,466::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 18:13:51,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,467::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,467::__init__::225::IOProcess::(_processLogs) (226) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,467::__init__::225::IOProcess::(_processLogs) (226) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,468::__init__::225::IOProcess::(_processLogs) (226) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,468::__init__::225::IOProcess::(_processLogs) (226) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,468::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:13:51,469::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,469::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 18:13:51,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,469::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,469::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,470::__init__::225::IOProcess::(_processLogs) (227) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:13:51,470::__init__::225::IOProcess::(_processLogs) (227) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:13:51,470::__init__::225::IOProcess::(_processLogs) (227) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,470::__init__::225::IOProcess::(_processLogs) (227) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,471::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,471::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:13:51,471::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-29::DEBUG::2014-08-12 18:13:51,472::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,472::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 18:13:51,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,472::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,473::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,473::__init__::225::IOProcess::(_processLogs) (228) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 18:13:51,473::__init__::225::IOProcess::(_processLogs) (228) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 18:13:51,473::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|(228) Building response >Thread-15::DEBUG::2014-08-12 18:13:51,473::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 18:13:51,474::__init__::225::IOProcess::(_processLogs) (228) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,475::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,475::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,475::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:13:51,475::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,476::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,476::__init__::225::IOProcess::(_processLogs) (229) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:13:51,476::__init__::225::IOProcess::(_processLogs) (229) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 18:13:51,477::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|(229) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,477::__init__::225::IOProcess::(_processLogs) (229) Queuing response >Thread-15::DEBUG::2014-08-12 18:13:51,478::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=880b1e00-85c8-4296-8d02-a32c1d378a1f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1f1e3d618d088808e2d3fa469a341ea67efd863e'] >Thread-29::DEBUG::2014-08-12 18:13:51,478::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,479::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 18:13:51,481::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,481::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 18:13:51,481::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,481::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,481::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,482::__init__::225::IOProcess::(_processLogs) (230) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:13:51,482::__init__::225::IOProcess::(_processLogs) (230) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:13:51,482::__init__::225::IOProcess::(_processLogs) (230) Building response >Thread-29::DEBUG::2014-08-12 18:13:51,482::__init__::225::IOProcess::(_processLogs) (230) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:51,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,483::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:13:51,483::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,484::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 18:13:51,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,484::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,484::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,484::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,485::__init__::225::IOProcess::(_processLogs) (231) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:13:51,485::__init__::225::IOProcess::(_processLogs) (231) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:13:51,485::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|(231) Building response >Thread-15::DEBUG::2014-08-12 18:13:51,485::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 18:13:51,486::__init__::225::IOProcess::(_processLogs) (231) Queuing response >Thread-15::DEBUG::2014-08-12 18:13:51,487::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '880b1e00-85c8-4296-8d02-a32c1d378a1f_imageNS' >Thread-29::DEBUG::2014-08-12 18:13:51,488::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:51,489::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 18:13:51,489::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '880b1e00-85c8-4296-8d02-a32c1d378a1f_volumeNS' >Thread-15::DEBUG::2014-08-12 18:13:51,490::clusterlock::143::Storage.initSANLock::(initSANLock) Initializing SANLock for domain 880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-15::DEBUG::2014-08-12 18:13:51,514::sd::443::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-15::DEBUG::2014-08-12 18:13:51,514::hsm::2685::Storage.HSM::(createStorageDomain) knownSDs: {880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 18:13:51,514::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-15::DEBUG::2014-08-12 18:13:51,514::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8dab722-5c20-4e60-ba9a-87b0f80f22aa`::finished: None >Thread-15::DEBUG::2014-08-12 18:13:51,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8dab722-5c20-4e60-ba9a-87b0f80f22aa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:13:51,515::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:51,515::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:51,515::task::993::Storage.TaskManager.Task::(_decref) Task=`d8dab722-5c20-4e60-ba9a-87b0f80f22aa`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:13:51,563::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [3c6ffe75] >Thread-15::DEBUG::2014-08-12 18:13:51,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b1457a7-5f05-4943-b2a8-b9343048e331`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:51,563::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='880b1e00-85c8-4296-8d02-a32c1d378a1f', options=None) >Thread-15::DEBUG::2014-08-12 18:13:51,564::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f`ReqID=`3191c699-c653-42a8-b8e4-6e3ba274aa40`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2824' at 'getStorageDomainStats' >Thread-15::DEBUG::2014-08-12 18:13:51,564::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 18:13:51,564::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 18:13:51,564::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f`ReqID=`3191c699-c653-42a8-b8e4-6e3ba274aa40`::Granted request >Thread-15::DEBUG::2014-08-12 18:13:51,565::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5b1457a7-5f05-4943-b2a8-b9343048e331`::_resourcesAcquired: Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f (shared) >Thread-15::DEBUG::2014-08-12 18:13:51,565::task::993::Storage.TaskManager.Task::(_decref) Task=`5b1457a7-5f05-4943-b2a8-b9343048e331`::ref 1 aborting False >Thread-29::DEBUG::2014-08-12 18:13:51,565::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:51,566::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:13:51,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:51,566::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:51,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:51,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:51,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:51,567::__init__::225::IOProcess::(_processLogs) (232) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:13:51,567::__init__::225::IOProcess::(_processLogs) (232) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:13:51,568::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|(232) Building response >Thread-15::INFO::2014-08-12 18:13:51,568::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21472411648', 'disktotal': '21474836480', 'mdafree': 0}} >Thread-29::DEBUG::2014-08-12 18:13:51,568::__init__::225::IOProcess::(_processLogs) (232) Queuing response >Thread-15::DEBUG::2014-08-12 18:13:51,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b1457a7-5f05-4943-b2a8-b9343048e331`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21472411648', 'disktotal': '21474836480', 'mdafree': 0}} >Thread-15::DEBUG::2014-08-12 18:13:51,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b1457a7-5f05-4943-b2a8-b9343048e331`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 18:13:51,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:13:51,569::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f': < ResourceRef 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f', isValid: 'True' obj: 'None'>} >Thread-29::DEBUG::2014-08-12 18:13:51,570::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 18:13:51,570::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:51,570::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' >Thread-15::DEBUG::2014-08-12 18:13:51,571::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' (0 active users) >Thread-15::DEBUG::2014-08-12 18:13:51,571::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:13:51,571::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f', Clearing records. >Thread-15::DEBUG::2014-08-12 18:13:51,571::task::993::Storage.TaskManager.Task::(_decref) Task=`5b1457a7-5f05-4943-b2a8-b9343048e331`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:13:51,820::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [30fc74d4] >Thread-15::DEBUG::2014-08-12 18:13:51,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`68564710-589e-4653-a1cd-fc1c103853a6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:51,821::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:13:51,821::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 18:13:51,859::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:13:51,859::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:13:51,859::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:13:51,860::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:13:51,860::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:13:51,860::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:13:51,880::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:13:51,883::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:13:51,940::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:13:51,941::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,941::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,941::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,941::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,941::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,942::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:13:51,942::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 18:13:51,942::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:13:51,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`68564710-589e-4653-a1cd-fc1c103853a6`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:13:51,943::task::595::Storage.TaskManager.Task::(_updateState) Task=`68564710-589e-4653-a1cd-fc1c103853a6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:13:51,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:51,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:51,944::task::993::Storage.TaskManager.Task::(_decref) Task=`68564710-589e-4653-a1cd-fc1c103853a6`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:13:52,155::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5b550148] >Thread-15::DEBUG::2014-08-12 18:13:52,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`051f7738-358d-43cf-a2cd-34868ce84ca0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:13:52,155::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:13:52,157::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 18:13:52,158::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=7,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 18:13:52,189::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:52,190::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 18:13:52,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:52,190::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:52,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:52,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:52,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:52,191::__init__::225::IOProcess::(_processLogs) (233) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:13:52,191::__init__::225::IOProcess::(_processLogs) (233) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:13:52,192::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|(233) Building response >Thread-29::DEBUG::2014-08-12 18:13:52,192::__init__::225::IOProcess::(_processLogs) (233) Queuing response >Thread-29::DEBUG::2014-08-12 18:13:52,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:13:52,192::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:13:52,202::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:13:52,203::__init__::225::IOProcess::(_processLogs) Sending response sized 79DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:13:52,203::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:13:52,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:13:52,204::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:13:52,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:13:52,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:13:52,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:13:52,204::__init__::225::IOProcess::(_processLogs) (234) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:13:52,205::__init__::225::IOProcess::(_processLogs) (234) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:13:52,205::__init__::225::IOProcess::(_processLogs) (234) Queuing response >Thread-15::DEBUG::2014-08-12 18:13:52,205::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'880b1e00-85c8-4296-8d02-a32c1d378a1f',) >Thread-29::DEBUG::2014-08-12 18:13:52,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:13:52,207::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 18:13:52,207::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::INFO::2014-08-12 18:13:52,208::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:13:52,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`051f7738-358d-43cf-a2cd-34868ce84ca0`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:13:52,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`051f7738-358d-43cf-a2cd-34868ce84ca0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:13:52,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:13:52,209::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:13:52,209::task::993::Storage.TaskManager.Task::(_decref) Task=`051f7738-358d-43cf-a2cd-34868ce84ca0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:14:01,067::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:14:01,068::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-16::DEBUG::2014-08-12 18:14:01,068::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-16::DEBUG::2014-08-12 18:14:01,068::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-16::DEBUG::2014-08-12 18:14:01,068::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-16::DEBUG::2014-08-12 18:14:01,069::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-16::DEBUG::2014-08-12 18:14:01,069::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,077::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:14:01,078::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-16::DEBUG::2014-08-12 18:14:01,092::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-16::DEBUG::2014-08-12 18:14:01,100::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:01,150::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:01,151::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,151::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,151::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,151::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,152::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,152::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,152::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-08-12 18:14:01,153::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-16::DEBUG::2014-08-12 18:14:01,154::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,154::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-17::DEBUG::2014-08-12 18:14:01,155::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-17::DEBUG::2014-08-12 18:14:01,157::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-17::DEBUG::2014-08-12 18:14:01,158::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:01,169::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,180::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-08-12 18:14:01,183::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,230::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:14:01,230::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 18:14:01,374::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:01,375::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,376::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:14:01,377::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,377::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,385::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,387::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000760155 s, 2.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:01,387::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000760155 s, 2.7 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:14:01,387::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,388::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:14:01,389::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:14:01,389::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:14:01,390::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,391::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,391::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Got the operational mutex >Thread-17::DEBUG::2014-08-12 18:14:01,391::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,392::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-16::DEBUG::2014-08-12 18:14:01,392::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,393::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 18:14:01,393::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,393::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,394::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-17::DEBUG::2014-08-12 18:14:01,398::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:01,404::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,579::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:14:01,579::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:14:01,580::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:01,590::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:14:01,591::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000469422 s, 4.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:14:01,593::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000469422 s, 4.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:14:01,593::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,594::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:14:01,595::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:14:01,596::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 18:14:01,596::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:14:01,599::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,601::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 18:14:01,602::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:14:01,603::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-17::DEBUG::2014-08-12 18:14:01,603::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::INFO::2014-08-12 18:14:01,604::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 18:14:01,606::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:01,607::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,608::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,616::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 18:14:01,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0aafa17-1ba1-43ff-9776-8fb808d16556`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:14:01,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:14:01,708::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605639', 'lastCheck': '10.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547825', 'lastCheck': '10.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:14:01,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0aafa17-1ba1-43ff-9776-8fb808d16556`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605639', 'lastCheck': '10.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547825', 'lastCheck': '10.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:14:01,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0aafa17-1ba1-43ff-9776-8fb808d16556`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:14:01,709::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:14:01,709::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:14:01,709::task::993::Storage.TaskManager.Task::(_decref) Task=`a0aafa17-1ba1-43ff-9776-8fb808d16556`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:14:01,785::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:01,785::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,795::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:01,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558077 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:14:01,799::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:14:01,799::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 18:14:01,800::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:14:01,800::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:14:01,800::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 18:14:01,801::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,967::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:14:01,968::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:01,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588791 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:11,802::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:11,820::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689161 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:14:11,980::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:11,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624148 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:14:16,814::task::595::Storage.TaskManager.Task::(_updateState) Task=`8346ee18-e693-4139-b7d2-03c6a4b542bc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:14:16,815::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:14:16,815::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689161', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624148', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:14:16,815::task::1191::Storage.TaskManager.Task::(prepare) Task=`8346ee18-e693-4139-b7d2-03c6a4b542bc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689161', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624148', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:14:16,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`8346ee18-e693-4139-b7d2-03c6a4b542bc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:14:16,815::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:14:16,816::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:14:16,816::task::993::Storage.TaskManager.Task::(_decref) Task=`8346ee18-e693-4139-b7d2-03c6a4b542bc`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:14:17,754::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [2aef8261] >Thread-15::DEBUG::2014-08-12 18:14:17,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8eb4f36-c4b3-446c-98a3-20df8c47e38e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:14:17,755::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:14:17,757::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:14:17,758::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:17,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:17,758::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:17,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:17,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:17,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:17,759::__init__::225::IOProcess::(_processLogs) (235) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:14:17,759::__init__::225::IOProcess::(_processLogs) (235) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:14:17,760::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(235) Building response >Thread-15::DEBUG::2014-08-12 18:14:17,760::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'880b1e00-85c8-4296-8d02-a32c1d378a1f',) >Thread-29::DEBUG::2014-08-12 18:14:17,761::__init__::225::IOProcess::(_processLogs) (235) Queuing response >Thread-15::DEBUG::2014-08-12 18:14:17,761::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 18:14:17,762::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 18:14:17,762::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-29::DEBUG::2014-08-12 18:14:17,763::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 18:14:17,763::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8eb4f36-c4b3-446c-98a3-20df8c47e38e`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:14:17,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8eb4f36-c4b3-446c-98a3-20df8c47e38e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:14:17,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:14:17,764::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:14:17,764::task::993::Storage.TaskManager.Task::(_decref) Task=`e8eb4f36-c4b3-446c-98a3-20df8c47e38e`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:14:17,995::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 18:14:17,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea2d515e-850d-4ac7-a472-35f220e73ba6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:14:17,996::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'880b1e00-85c8-4296-8d02-a32c1d378a1f': 'active', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 18:14:17,996::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`0072177b-74f3-4346-9f2d-215a387c34b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 18:14:17,996::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 18:14:17,997::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 18:14:17,997::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`0072177b-74f3-4346-9f2d-215a387c34b9`::Granted request >Thread-15::DEBUG::2014-08-12 18:14:17,997::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9daecccf-ab11-445d-94e2-8e02563d0389`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 18:14:17,997::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 18:14:17,998::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 18:14:17,998::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`9daecccf-ab11-445d-94e2-8e02563d0389`::Granted request >Thread-15::DEBUG::2014-08-12 18:14:17,998::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'880b1e00-85c8-4296-8d02-a32c1d378a1f': 'active', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 18:14:17,998::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'880b1e00-85c8-4296-8d02-a32c1d378a1f': 'Active', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::DEBUG::2014-08-12 18:14:17,999::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:17,999::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:17,999::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:17,999::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:17,999::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,000::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,000::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:14:18,000::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:14:18,000::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:14:18,000::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:14:18,000::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:14:18,001::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:14:18,035::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:14:18,038::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:14:18,109::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:14:18,110::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,110::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,110::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,111::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,111::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,111::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,111::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:14:18,111::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,114::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 18:14:18,337::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:14:18,338::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,338::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 18:14:18,339::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 18:14:18,347::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000523193 s, 3.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:14:18,348::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000523193 s, 3.9 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 18:14:18,348::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 18:14:18,348::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 18:14:18,348::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 18:14:18,349::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,349::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,349::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,349::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,350::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,350::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 18:14:18,528::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:14:18,529::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,529::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 18:14:18,530::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 18:14:18,530::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 18:14:18,531::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 18:14:18,531::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 18:14:18,531::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 18:14:18,531::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 18:14:18,531::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-15::DEBUG::2014-08-12 18:14:18,532::sp::1410::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` started monitoring domain `880b1e00-85c8-4296-8d02-a32c1d378a1f` >Thread-60::DEBUG::2014-08-12 18:14:18,533::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-15::DEBUG::2014-08-12 18:14:18,533::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:14:18,535::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 18:14:18,537::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-29::DEBUG::2014-08-12 18:14:18,543::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-15::DEBUG::2014-08-12 18:14:18,544::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-29::DEBUG::2014-08-12 18:14:18,546::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:14:18,549::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-15::DEBUG::2014-08-12 18:14:18,548::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 880b1e00-85c8-4296-8d02-a32c1d378a1f 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-29::DEBUG::2014-08-12 18:14:18,558::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:18,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:18,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:18,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:18,564::__init__::225::IOProcess::(_processLogs) (236) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:14:18,566::__init__::225::IOProcess::(_processLogs) (236) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:14:18,569::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(236) Building response >Thread-29::DEBUG::2014-08-12 18:14:18,573::__init__::225::IOProcess::(_processLogs) (236) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:18,577::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:14:18,578::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-60::DEBUG::2014-08-12 18:14:18,584::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-29::DEBUG::2014-08-12 18:14:18,585::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:18,585::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 18:14:18,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:18,585::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:18,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:18,585::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:18,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:18,586::__init__::225::IOProcess::(_processLogs) (237) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 18:14:18,586::__init__::225::IOProcess::(_processLogs) (237) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 18:14:18,586::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(237) Building response >Thread-29::DEBUG::2014-08-12 18:14:18,586::__init__::225::IOProcess::(_processLogs) (237) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:18,587::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-60::DEBUG::2014-08-12 18:14:18,587::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 18:14:18,588::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:14:18,589::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:18,589::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:14:18,589::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:18,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:18,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:18,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:18,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:18,590::__init__::225::IOProcess::(_processLogs) (238) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:14:18,590::__init__::225::IOProcess::(_processLogs) (238) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 18:14:18,591::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(238) Building response >Thread-60::DEBUG::2014-08-12 18:14:18,591::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=880b1e00-85c8-4296-8d02-a32c1d378a1f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=80871694ae2f06ac4765daee93da9f1510766a1e'] >Thread-29::DEBUG::2014-08-12 18:14:18,592::__init__::225::IOProcess::(_processLogs) (238) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:18,593::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:14:18,594::__init__::225::IOProcess::(_processLogs) Sending response sized 543 >Thread-29::DEBUG::2014-08-12 18:14:18,594::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:18,594::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 18:14:18,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:18,595::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:18,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:18,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:18,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:18,596::__init__::225::IOProcess::(_processLogs) (239) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:14:18,596::__init__::225::IOProcess::(_processLogs) (239) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:14:18,596::__init__::225::IOProcess::(_processLogs) (239) Building response >Thread-29::DEBUG::2014-08-12 18:14:18,597::__init__::225::IOProcess::(_processLogs) (239) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:18,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:14:18,597::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:14:18,597::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:18,597::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 18:14:18,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:18,598::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:18,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:18,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:18,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:18,598::__init__::225::IOProcess::(_processLogs) (240) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:14:18,598::__init__::225::IOProcess::(_processLogs) (240) Got request for method 'glob' >Thread-60::DEBUG::2014-08-12 18:14:18,599::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 18:14:18,599::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(240) Building response >Thread-60::INFO::2014-08-12 18:14:18,600::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 880b1e00-85c8-4296-8d02-a32c1d378a1f_imageNS already registered >Thread-29::DEBUG::2014-08-12 18:14:18,600::__init__::225::IOProcess::(_processLogs) (240) Queuing response >Thread-60::INFO::2014-08-12 18:14:18,601::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 880b1e00-85c8-4296-8d02-a32c1d378a1f_volumeNS already registered >Thread-29::DEBUG::2014-08-12 18:14:18,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:14:18,603::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:14:18,603::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:18,603::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:18,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:18,604::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:18,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:18,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:18,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:18,604::__init__::225::IOProcess::(_processLogs) (241) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:18,604::__init__::225::IOProcess::(_processLogs) (241) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:18,605::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(241) Building response >Thread-60::DEBUG::2014-08-12 18:14:18,606::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 18:14:18,606::__init__::225::IOProcess::(_processLogs) (241) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:18,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-60::DEBUG::2014-08-12 18:14:18,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000408612 s, 861 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:14:18,616::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 18:14:18,618::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:18,618::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:18,618::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:18,618::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:18,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:18,618::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:18,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:18,619::__init__::225::IOProcess::(_processLogs) (242) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:18,619::__init__::225::IOProcess::(_processLogs) (242) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:18,620::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(242) Building response >Thread-29::DEBUG::2014-08-12 18:14:18,620::__init__::225::IOProcess::(_processLogs) (242) Queuing response >Thread-60::DEBUG::2014-08-12 18:14:18,621::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 880b1e00-85c8-4296-8d02-a32c1d378a1f changed its status to Valid >Thread-29::DEBUG::2014-08-12 18:14:18,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-60::INFO::2014-08-12 18:14:18,622::clusterlock::183::Storage.SANLock::(acquireHostId) Acquiring host id for domain 880b1e00-85c8-4296-8d02-a32c1d378a1f (id: 1) >Thread-62::DEBUG::2014-08-12 18:14:18,622::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-29::DEBUG::2014-08-12 18:14:18,623::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-60::DEBUG::2014-08-12 18:14:18,624::clusterlock::201::Storage.SANLock::(acquireHostId) Host id for domain 880b1e00-85c8-4296-8d02-a32c1d378a1f successfully acquired (id: 1) >Thread-62::DEBUG::2014-08-12 18:14:18,624::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-62::DEBUG::2014-08-12 18:14:18,626::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-63::INFO::2014-08-12 18:14:18,626::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >Thread-15::DEBUG::2014-08-12 18:14:18,746::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "880b1e00-85c8-4296-8d02-a32c1d378a1f" not found\n Skipping volume group 880b1e00-85c8-4296-8d02-a32c1d378a1f\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 18:14:18,748::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [' DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc|180aea8f-26ba-4e87-8a94-37d5469519bf|wz--n-|42547019776|22011707392|134217728|317|164|MDT_LEASETIMESEC=60,MDT_VERSION=3,MDT_TYPE=ISCSI,MDT_SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf,MDT_PV0=pv:3600601601282300060dddcba33f2e311&44&uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP&44&pestart:0&44&pecount:317&44&mapoffset:0,MDT_LEASERETRIES=3,MDT_IOOPTIMEOUTSEC=10,MDT_LOCKRENEWALINTERVALSEC=5,MDT_LOCKPOLICY=,MDT_ROLE=Regular,MDT_PHYBLKSIZE=512,MDT_LOGBLKSIZE=512,MDT_VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc,MDT_CLASS=Data,MDT_DESCRIPTION=iscsi_1,RHAT_storage_domain,MDT_POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a,MDT__SHA_CKSUM=189d056969591a327adf4c729525fafb366effde|134217728|67100160|15|1|/dev/mapper/3600601601282300060dddcba33f2e311'] [' Volume group "880b1e00-85c8-4296-8d02-a32c1d378a1f" not found', ' Skipping volume group 880b1e00-85c8-4296-8d02-a32c1d378a1f'] >Thread-15::DEBUG::2014-08-12 18:14:18,749::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:14:18,749::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 18:14:18,749::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 18:14:18,749::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 18:14:18,749::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 18:14:18,750::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:18,751::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:14:18,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:18,751::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:18,751::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-15::INFO::2014-08-12 18:14:18,752::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-29::DEBUG::2014-08-12 18:14:18,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:18,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:18,755::__init__::225::IOProcess::(_processLogs) (243) Finding callback 'glob'... >Thread-15::DEBUG::2014-08-12 18:14:18,754::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-29::DEBUG::2014-08-12 18:14:18,755::__init__::225::IOProcess::(_processLogs) (243) Got request for method 'glob' >Thread-15::INFO::2014-08-12 18:14:18,756::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 18:14:18,757::__init__::225::IOProcess::(_processLogs) (243) Building response >Thread-15::DEBUG::2014-08-12 18:14:18,757::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 18:14:18,758::__init__::225::IOProcess::(_processLogs) (243) Queuing response >Thread-15::DEBUG::2014-08-12 18:14:18,759::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-29::DEBUG::2014-08-12 18:14:18,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::WARNING::2014-08-12 18:14:18,760::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-29::DEBUG::2014-08-12 18:14:18,761::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 18:14:18,761::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 18:14:18,762::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 18:14:18,762::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 18:14:18,763::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 18:14:18,763::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 18:14:18,763::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 18:14:18,763::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 18:14:18,764::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 18:14:18,764::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:14:18,764::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 18:14:18,764::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 18:14:18,764::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 18:14:18,764::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:14:18,765::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 18:14:18,765::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 18:14:18,765::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea2d515e-850d-4ac7-a472-35f220e73ba6`::finished: True >Thread-15::DEBUG::2014-08-12 18:14:18,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea2d515e-850d-4ac7-a472-35f220e73ba6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:14:18,765::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:14:18,766::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:14:18,766::task::993::Storage.TaskManager.Task::(_decref) Task=`ea2d515e-850d-4ac7-a472-35f220e73ba6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:14:21,821::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:14:21,822::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:21,847::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000565754 s, 3.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:21,847::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000565754 s, 3.6 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:14:21,847::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:14:21,848::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:14:21,848::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:14:21,848::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:21,848::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:21,849::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:21,849::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:21,849::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:21,849::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:21,992::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:22,033::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:22,034::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:14:22,034::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:14:22,035::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:14:22,035::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:14:22,036::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:14:22,036::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:22,164::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:14:22,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:22,174::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000553952 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:22,203::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:22,203::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:22,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552194 s, 7.4 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:14:28,626::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:28,633::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:28,636::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-60::DEBUG::2014-08-12 18:14:28,638::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 18:14:28,638::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:28,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:28,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:28,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-60::DEBUG::2014-08-12 18:14:28,652::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00117622 s, 299 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:14:28,652::__init__::225::IOProcess::(_processLogs) (244) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:28,653::__init__::225::IOProcess::(_processLogs) (244) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:28,654::__init__::225::IOProcess::(_processLogs) (244) Building response >Thread-29::DEBUG::2014-08-12 18:14:28,654::__init__::225::IOProcess::(_processLogs) (244) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:28,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:14:28,654::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 18:14:28,654::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:14:28,655::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:28,655::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:28,655::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:28,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:28,655::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:28,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:28,656::__init__::225::IOProcess::(_processLogs) (245) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:28,656::__init__::225::IOProcess::(_processLogs) (245) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:28,656::__init__::225::IOProcess::(_processLogs) (245) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:28,657::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 18:14:31,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`b39d63e9-307f-491a-b2b3-5664ac3c2005`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:14:31,975::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:14:31,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00117622', 'lastCheck': '3.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552194', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553952', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:14:31,975::task::1191::Storage.TaskManager.Task::(prepare) Task=`b39d63e9-307f-491a-b2b3-5664ac3c2005`::finished: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00117622', 'lastCheck': '3.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552194', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553952', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:14:31,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`b39d63e9-307f-491a-b2b3-5664ac3c2005`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:14:31,976::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:14:31,976::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:14:31,976::task::993::Storage.TaskManager.Task::(_decref) Task=`b39d63e9-307f-491a-b2b3-5664ac3c2005`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:14:32,177::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:32,186::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719164 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:32,213::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:32,221::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654719 s, 6.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:14:38,660::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:38,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:38,660::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:38,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:38,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-60::DEBUG::2014-08-12 18:14:38,662::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 18:14:38,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:38,670::__init__::225::IOProcess::(_processLogs) (246) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:38,672::__init__::225::IOProcess::(_processLogs) (246) Got request for method 'statvfs' >Thread-60::DEBUG::2014-08-12 18:14:38,672::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000453862 s, 776 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:14:38,673::__init__::225::IOProcess::(_processLogs) (246) Building response >Thread-29::DEBUG::2014-08-12 18:14:38,674::__init__::225::IOProcess::(_processLogs) (246) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:38,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:14:38,675::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 18:14:38,675::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:38,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:38,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:38,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:38,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:38,676::__init__::225::IOProcess::(_processLogs) (247) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:38,676::__init__::225::IOProcess::(_processLogs) (247) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:38,677::__init__::225::IOProcess::(_processLogs) (247) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:38,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:14:38,678::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 18:14:42,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:42,198::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103488 s, 4.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:42,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:42,232::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814545 s, 5.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:14:47,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9654399-fe37-4827-b330-717d8b84a4cc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:14:47,080::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:14:47,081::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000453862', 'lastCheck': '8.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814545', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103488', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:14:47,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9654399-fe37-4827-b330-717d8b84a4cc`::finished: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000453862', 'lastCheck': '8.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814545', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103488', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:14:47,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9654399-fe37-4827-b330-717d8b84a4cc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:14:47,081::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:14:47,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:14:47,082::task::993::Storage.TaskManager.Task::(_decref) Task=`e9654399-fe37-4827-b330-717d8b84a4cc`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 18:14:48,686::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:48,686::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:48,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:48,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:48,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:48,686::__init__::225::IOProcess::(_processLogs) (248) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:48,686::__init__::225::IOProcess::(_processLogs) (248) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:48,687::__init__::225::IOProcess::(_processLogs) (248) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:48,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-60::DEBUG::2014-08-12 18:14:48,688::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 18:14:48,689::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-60::DEBUG::2014-08-12 18:14:48,697::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000391017 s, 900 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:14:48,698::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:48,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:48,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:48,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:48,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:48,699::__init__::225::IOProcess::(_processLogs) (249) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:48,699::__init__::225::IOProcess::(_processLogs) (249) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:48,699::__init__::225::IOProcess::(_processLogs) (249) Building response >Thread-29::DEBUG::2014-08-12 18:14:48,699::__init__::225::IOProcess::(_processLogs) (249) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:48,700::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 18:14:52,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:14:52,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617677 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:14:52,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:14:52,240::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000561348 s, 7.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:14:58,702::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:58,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:58,703::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:58,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:58,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:58,703::__init__::225::IOProcess::(_processLogs) (250) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:58,704::__init__::225::IOProcess::(_processLogs) (250) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:58,704::__init__::225::IOProcess::(_processLogs) (250) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:58,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-60::DEBUG::2014-08-12 18:14:58,705::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-60::DEBUG::2014-08-12 18:14:58,716::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00037718 s, 933 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:14:58,717::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:14:58,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:14:58,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:14:58,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:14:58,718::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:14:58,718::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:14:58,718::__init__::225::IOProcess::(_processLogs) (251) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:14:58,718::__init__::225::IOProcess::(_processLogs) (251) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:14:58,719::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(251) Building response >Thread-29::DEBUG::2014-08-12 18:14:58,720::__init__::225::IOProcess::(_processLogs) (251) Queuing response >Thread-29::DEBUG::2014-08-12 18:14:58,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:14:58,721::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 18:15:02,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`228d14ce-781e-4479-976d-981eda60f41e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:15:02,191::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:15:02,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037718', 'lastCheck': '3.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561348', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617677', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:15:02,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`228d14ce-781e-4479-976d-981eda60f41e`::finished: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037718', 'lastCheck': '3.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561348', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617677', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:15:02,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`228d14ce-781e-4479-976d-981eda60f41e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:15:02,192::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:15:02,192::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:15:02,192::task::993::Storage.TaskManager.Task::(_decref) Task=`228d14ce-781e-4479-976d-981eda60f41e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:15:02,215::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:15:02,224::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651182 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:15:02,242::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:15:02,251::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662358 s, 6.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:08,722::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:08,722::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:08,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:08,722::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:08,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:08,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:08,723::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:08,724::__init__::225::IOProcess::(_processLogs) (252) Finding callback 'statvfs'... >Thread-60::DEBUG::2014-08-12 18:15:08,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 18:15:08,725::__init__::225::IOProcess::(_processLogs) (252) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:08,733::__init__::225::IOProcess::(_processLogs) (252) Building response >Thread-29::DEBUG::2014-08-12 18:15:08,733::__init__::225::IOProcess::(_processLogs) (252) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:08,733::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:15:08,734::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-60::DEBUG::2014-08-12 18:15:08,736::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.00210512 s, 167 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:08,737::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:08,737::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:08,738::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:08,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:08,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:08,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:08,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:08,739::__init__::225::IOProcess::(_processLogs) (253) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:08,739::__init__::225::IOProcess::(_processLogs) (253) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:08,739::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(253) Building response >Thread-29::DEBUG::2014-08-12 18:15:08,739::__init__::225::IOProcess::(_processLogs) (253) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:08,740::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 18:15:08,741::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 18:15:12,228::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:15:12,236::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644909 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:15:12,252::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:15:12,261::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585043 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:15:17,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d7fa60d-7f84-45a6-a24d-d3725a726e8d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:15:17,341::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:15:17,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00210512', 'lastCheck': '8.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585043', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644909', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:15:17,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d7fa60d-7f84-45a6-a24d-d3725a726e8d`::finished: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00210512', 'lastCheck': '8.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585043', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644909', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:15:17,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d7fa60d-7f84-45a6-a24d-d3725a726e8d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:15:17,341::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:15:17,342::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:15:17,342::task::993::Storage.TaskManager.Task::(_decref) Task=`3d7fa60d-7f84-45a6-a24d-d3725a726e8d`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 18:15:18,742::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:18,743::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:18,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:18,743::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:18,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:18,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:18,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:18,744::__init__::225::IOProcess::(_processLogs) (254) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:18,744::__init__::225::IOProcess::(_processLogs) (254) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:18,744::__init__::225::IOProcess::(_processLogs) (254) Building response >Thread-29::DEBUG::2014-08-12 18:15:18,744::__init__::225::IOProcess::(_processLogs) (254) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:18,745::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 18:15:18,746::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-60::DEBUG::2014-08-12 18:15:18,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-60::DEBUG::2014-08-12 18:15:18,755::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000494884 s, 711 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:18,756::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:18,756::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:18,757::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:18,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:18,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:18,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:18,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:18,757::__init__::225::IOProcess::(_processLogs) (255) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:18,758::__init__::225::IOProcess::(_processLogs) (255) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:18,758::__init__::225::IOProcess::(_processLogs) (255) Building response >Thread-29::DEBUG::2014-08-12 18:15:18,758::__init__::225::IOProcess::(_processLogs) (255) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:18,758::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 18:15:18,759::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 18:15:22,240::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:15:22,249::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645381 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:15:22,262::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:15:22,270::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056041 s, 7.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:28,760::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:28,761::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:28,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:28,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:28,761::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:28,761::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:28,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:28,762::__init__::225::IOProcess::(_processLogs) (256) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:28,762::__init__::225::IOProcess::(_processLogs) (256) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:28,762::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(256) Building response >Thread-60::DEBUG::2014-08-12 18:15:28,763::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 18:15:28,763::__init__::225::IOProcess::(_processLogs) (256) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:28,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-60::DEBUG::2014-08-12 18:15:28,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000394008 s, 893 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:28,775::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 18:15:28,777::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:28,777::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:28,777::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:28,777::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:28,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:28,778::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:28,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:28,778::__init__::225::IOProcess::(_processLogs) (257) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:28,778::__init__::225::IOProcess::(_processLogs) (257) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:28,779::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(257) Building response >Thread-29::DEBUG::2014-08-12 18:15:28,780::__init__::225::IOProcess::(_processLogs) (257) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:28,780::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:15:28,781::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 18:15:32,252::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:15:32,261::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000773305 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:15:32,271::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:15:32,279::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586001 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:15:32,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e31f8fd-210a-4cad-a60d-c0dfef5133ac`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:15:32,480::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:15:32,481::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394008', 'lastCheck': '3.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586001', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773305', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:15:32,481::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e31f8fd-210a-4cad-a60d-c0dfef5133ac`::finished: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394008', 'lastCheck': '3.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586001', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773305', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:15:32,481::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e31f8fd-210a-4cad-a60d-c0dfef5133ac`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:15:32,481::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:15:32,481::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:15:32,482::task::993::Storage.TaskManager.Task::(_decref) Task=`9e31f8fd-210a-4cad-a60d-c0dfef5133ac`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 18:15:38,781::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:38,782::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:38,782::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:38,782::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:38,782::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:38,782::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:38,782::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:38,783::__init__::225::IOProcess::(_processLogs) (258) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:38,783::__init__::225::IOProcess::(_processLogs) (258) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:38,784::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(258) Building response >Thread-29::DEBUG::2014-08-12 18:15:38,786::__init__::225::IOProcess::(_processLogs) (258) Queuing response >Thread-60::DEBUG::2014-08-12 18:15:38,786::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 18:15:38,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:15:38,795::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-60::DEBUG::2014-08-12 18:15:38,795::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000373636 s, 942 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:38,796::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:38,796::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:38,797::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:38,797::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:38,797::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:38,797::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:38,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:38,797::__init__::225::IOProcess::(_processLogs) (259) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:38,798::__init__::225::IOProcess::(_processLogs) (259) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:38,798::__init__::225::IOProcess::(_processLogs) (259) Building response >Thread-29::DEBUG::2014-08-12 18:15:38,798::__init__::225::IOProcess::(_processLogs) (259) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:38,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:15:38,799::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 318 >Thread-17::DEBUG::2014-08-12 18:15:42,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:15:42,273::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683586 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:15:42,280::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:15:42,289::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062618 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:15:47,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`64de3143-1fff-4bb7-ba63-ccb63e92aa24`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:15:47,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:15:47,609::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373636', 'lastCheck': '8.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062618', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683586', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:15:47,610::task::1191::Storage.TaskManager.Task::(prepare) Task=`64de3143-1fff-4bb7-ba63-ccb63e92aa24`::finished: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373636', 'lastCheck': '8.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062618', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683586', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:15:47,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`64de3143-1fff-4bb7-ba63-ccb63e92aa24`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:15:47,610::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:15:47,610::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:15:47,610::task::993::Storage.TaskManager.Task::(_decref) Task=`64de3143-1fff-4bb7-ba63-ccb63e92aa24`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 18:15:48,801::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:48,801::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:48,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:48,802::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:48,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:48,802::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:48,802::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:48,802::__init__::225::IOProcess::(_processLogs) (260) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:48,802::__init__::225::IOProcess::(_processLogs) (260) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:48,802::__init__::225::IOProcess::(_processLogs) (260) Building response >Thread-29::DEBUG::2014-08-12 18:15:48,803::__init__::225::IOProcess::(_processLogs) (260) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:48,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:15:48,804::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 318 >Thread-60::DEBUG::2014-08-12 18:15:48,805::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-60::DEBUG::2014-08-12 18:15:48,813::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000546921 s, 644 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:48,814::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:48,815::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:48,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:48,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:48,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:48,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:48,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:48,816::__init__::225::IOProcess::(_processLogs) (261) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:48,816::__init__::225::IOProcess::(_processLogs) (261) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:48,816::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(261) Building response >Thread-29::DEBUG::2014-08-12 18:15:48,817::__init__::225::IOProcess::(_processLogs) (261) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:48,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:15:48,818::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 18:15:52,277::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:15:52,286::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609639 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:15:52,290::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:15:52,299::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000513171 s, 8.0 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:58,819::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:58,819::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:58,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:58,820::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:58,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:58,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:58,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:58,820::__init__::225::IOProcess::(_processLogs) (262) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:58,820::__init__::225::IOProcess::(_processLogs) (262) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:58,821::__init__::225::IOProcess::(_processLogs) (262) Building response >Thread-29::DEBUG::2014-08-12 18:15:58,821::__init__::225::IOProcess::(_processLogs) (262) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:58,821::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 18:15:58,823::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-60::DEBUG::2014-08-12 18:15:58,823::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-60::DEBUG::2014-08-12 18:15:58,832::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n352 bytes (352 B) copied, 0.000808846 s, 435 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:15:58,833::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:15:58,833::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:15:58,833::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:15:58,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:15:58,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:15:58,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:15:58,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:15:58,834::__init__::225::IOProcess::(_processLogs) (263) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:15:58,834::__init__::225::IOProcess::(_processLogs) (263) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:15:58,834::__init__::225::IOProcess::(_processLogs) (263) Building response >Thread-29::DEBUG::2014-08-12 18:15:58,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(263) Queuing response >Thread-29::DEBUG::2014-08-12 18:15:58,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:15:58,837::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-17::DEBUG::2014-08-12 18:16:02,290::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:16:02,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709398 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:16:02,301::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:02,308::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692339 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:02,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`24effacb-5cc0-4311-b234-0a1d00059065`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:16:02,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:16:02,729::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808846', 'lastCheck': '3.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692339', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709398', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:16:02,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`24effacb-5cc0-4311-b234-0a1d00059065`::finished: {'880b1e00-85c8-4296-8d02-a32c1d378a1f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808846', 'lastCheck': '3.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692339', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709398', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:16:02,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`24effacb-5cc0-4311-b234-0a1d00059065`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:16:02,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:16:02,730::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:16:02,730::task::993::Storage.TaskManager.Task::(_decref) Task=`24effacb-5cc0-4311-b234-0a1d00059065`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:16:04,017::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 18:16:04,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`a65171b6-27dc-4d86-88a4-efd9d923365c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:16:04,034::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'880b1e00-85c8-4296-8d02-a32c1d378a1f': 'attached', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 18:16:04,035::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`f9552a0f-3e23-41ce-8ddb-14f5f84eb4d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 18:16:04,035::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 18:16:04,035::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 18:16:04,035::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`f9552a0f-3e23-41ce-8ddb-14f5f84eb4d5`::Granted request >Thread-15::DEBUG::2014-08-12 18:16:04,036::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`4b95c651-3085-48cf-bb50-173eda85d301`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 18:16:04,036::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 18:16:04,036::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 18:16:04,036::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`4b95c651-3085-48cf-bb50-173eda85d301`::Granted request >Thread-15::DEBUG::2014-08-12 18:16:04,037::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'880b1e00-85c8-4296-8d02-a32c1d378a1f': 'attached', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 18:16:04,037::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'880b1e00-85c8-4296-8d02-a32c1d378a1f': 'Attached', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::DEBUG::2014-08-12 18:16:04,037::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,037::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,038::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,038::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,038::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,038::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,039::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:16:04,039::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:16:04,039::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:16:04,039::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:16:04,039::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:16:04,039::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:04,077::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:16:04,079::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:04,165::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:04,166::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,166::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,166::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,166::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,167::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,167::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,167::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:16:04,167::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,170::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:04,393::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:04,394::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,394::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 18:16:04,395::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:04,403::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000556327 s, 3.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:04,403::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000556327 s, 3.7 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 18:16:04,404::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 18:16:04,404::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 18:16:04,404::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 18:16:04,404::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,405::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,405::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,405::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,405::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,406::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:04,586::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:04,586::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:04,587::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 18:16:04,588::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 18:16:04,588::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 18:16:04,589::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 18:16:04,589::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 18:16:04,589::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 18:16:04,589::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 18:16:04,589::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-60::DEBUG::2014-08-12 18:16:04,590::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-29::DEBUG::2014-08-12 18:16:04,591::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:16:04,591::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:16:04,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:16:04,592::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:16:04,592::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:16:04,592::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:16:04,592::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:16:04,592::__init__::225::IOProcess::(_processLogs) (264) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:16:04,592::__init__::225::IOProcess::(_processLogs) (264) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:16:04,593::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(264) Building response >Thread-29::DEBUG::2014-08-12 18:16:04,595::__init__::225::IOProcess::(_processLogs) (264) Queuing response >Thread-29::DEBUG::2014-08-12 18:16:04,596::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:16:04,598::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-60::DEBUG::2014-08-12 18:16:04,601::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-29::DEBUG::2014-08-12 18:16:04,601::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:16:04,601::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 18:16:04,602::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:16:04,602::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:16:04,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:16:04,602::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:16:04,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:16:04,602::__init__::225::IOProcess::(_processLogs) (265) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 18:16:04,602::__init__::225::IOProcess::(_processLogs) (265) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 18:16:04,603::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(265) Building response >Thread-60::DEBUG::2014-08-12 18:16:04,603::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 18:16:04,604::__init__::225::IOProcess::(_processLogs) (265) Queuing response >Thread-29::DEBUG::2014-08-12 18:16:04,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:16:04,605::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:16:04,606::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:16:04,606::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:16:04,606::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:16:04,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:16:04,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:16:04,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:16:04,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:16:04,607::__init__::225::IOProcess::(_processLogs) (266) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:16:04,607::__init__::225::IOProcess::(_processLogs) (266) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 18:16:04,607::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(266) Building response >Thread-29::DEBUG::2014-08-12 18:16:04,608::__init__::225::IOProcess::(_processLogs) (266) Queuing response >Thread-29::DEBUG::2014-08-12 18:16:04,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:16:04,608::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 543 >Thread-60::DEBUG::2014-08-12 18:16:04,609::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=880b1e00-85c8-4296-8d02-a32c1d378a1f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=80871694ae2f06ac4765daee93da9f1510766a1e'] >Thread-29::DEBUG::2014-08-12 18:16:04,610::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:16:04,610::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 18:16:04,611::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:16:04,611::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:16:04,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:16:04,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:16:04,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:16:04,612::__init__::225::IOProcess::(_processLogs) (267) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:16:04,612::__init__::225::IOProcess::(_processLogs) (267) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:16:04,612::__init__::225::IOProcess::(_processLogs) (267) Building response >Thread-29::DEBUG::2014-08-12 18:16:04,612::__init__::225::IOProcess::(_processLogs) (267) Queuing response >Thread-29::DEBUG::2014-08-12 18:16:04,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:16:04,613::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:16:04,613::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:16:04,613::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 18:16:04,613::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:16:04,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:16:04,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:16:04,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:16:04,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:16:04,614::__init__::225::IOProcess::(_processLogs) (268) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:16:04,614::__init__::225::IOProcess::(_processLogs) (268) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:16:04,615::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(268) Building response >Thread-29::DEBUG::2014-08-12 18:16:04,615::__init__::225::IOProcess::(_processLogs) (268) Queuing response >Thread-29::DEBUG::2014-08-12 18:16:04,615::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-60::DEBUG::2014-08-12 18:16:04,616::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 18:16:04,616::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-60::INFO::2014-08-12 18:16:04,617::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 880b1e00-85c8-4296-8d02-a32c1d378a1f_imageNS already registered >Thread-60::INFO::2014-08-12 18:16:04,618::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 880b1e00-85c8-4296-8d02-a32c1d378a1f_volumeNS already registered >Thread-60::INFO::2014-08-12 18:16:04,618::clusterlock::206::Storage.SANLock::(releaseHostId) Releasing host id for domain 880b1e00-85c8-4296-8d02-a32c1d378a1f (id: 1) >Thread-60::DEBUG::2014-08-12 18:16:06,619::clusterlock::216::Storage.SANLock::(releaseHostId) Host id for domain 880b1e00-85c8-4296-8d02-a32c1d378a1f released successfully (id: 1) >Thread-15::DEBUG::2014-08-12 18:16:06,620::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` stopped monitoring domain `880b1e00-85c8-4296-8d02-a32c1d378a1f` >Thread-15::DEBUG::2014-08-12 18:16:06,620::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:16:06,620::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 18:16:06,620::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 18:16:06,621::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:06,621::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:06,801::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:06,802::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:06,802::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 18:16:06,802::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 18:16:06,803::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 18:16:06,803::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 18:16:06,804::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:16:06,804::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:16:06,805::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 18:16:06,805::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:16:06,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:16:06,805::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:16:06,805::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:16:06,805::__init__::225::IOProcess::(_processLogs) (269) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:16:06,805::__init__::225::IOProcess::(_processLogs) (269) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:16:06,806::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(269) Building response >Thread-15::INFO::2014-08-12 18:16:06,807::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 18:16:06,808::__init__::225::IOProcess::(_processLogs) (269) Queuing response >Thread-15::DEBUG::2014-08-12 18:16:06,808::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 18:16:06,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:16:06,809::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 18:16:06,810::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-29::DEBUG::2014-08-12 18:16:06,810::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 18:16:06,811::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 18:16:06,812::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 18:16:06,812::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 18:16:06,812::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 18:16:06,812::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 18:16:06,813::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 18:16:06,813::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 18:16:06,813::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 18:16:06,813::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:16:06,814::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 18:16:06,814::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 18:16:06,814::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 18:16:06,814::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:16:06,814::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 18:16:06,815::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 18:16:06,815::task::1191::Storage.TaskManager.Task::(prepare) Task=`a65171b6-27dc-4d86-88a4-efd9d923365c`::finished: True >Thread-15::DEBUG::2014-08-12 18:16:06,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`a65171b6-27dc-4d86-88a4-efd9d923365c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:16:06,815::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:16:06,815::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:16:06,815::task::993::Storage.TaskManager.Task::(_decref) Task=`a65171b6-27dc-4d86-88a4-efd9d923365c`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:16:06,832::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [47772931] >Thread-15::DEBUG::2014-08-12 18:16:06,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`f95bb7de-a698-4c7e-8e9d-b8d37bdc80fa`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:16:06,833::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:16:06,833::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:06,886::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:16:06,886::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:16:06,886::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:16:06,886::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:16:06,886::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:16:06,887::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:06,907::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:16:06,915::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:16:06,963::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:06,963::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:06,963::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:06,964::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:06,964::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:06,964::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:06,964::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:16:06,965::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 18:16:06,965::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:16:06,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`f95bb7de-a698-4c7e-8e9d-b8d37bdc80fa`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:16:06,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`f95bb7de-a698-4c7e-8e9d-b8d37bdc80fa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:16:06,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:16:06,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:16:06,966::task::993::Storage.TaskManager.Task::(_decref) Task=`f95bb7de-a698-4c7e-8e9d-b8d37bdc80fa`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:16:12,303::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:12,312::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,312::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:16:12,502::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:16:12,503::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:12,512::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:16:12,514::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000481726 s, 8.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:16:12,514::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,515::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:16:12,516::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,517::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:16:12,517::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:12,531::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000485808 s, 4.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:16:12,531::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000485808 s, 4.2 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:16:12,531::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:16:12,532::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:16:12,532::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:16:12,532::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 18:16:12,704::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:16:12,704::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,705::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,707::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,708::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,709::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,710::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,712::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:12,893::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:16:12,894::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:16:12,894::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:16:12,895::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:16:12,895::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:16:12,896::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:16:12,896::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:13,066::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:16:13,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:13,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598394 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:17,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`844cce35-e524-4432-b5d6-6b6602c9f8dd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:16:17,852::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:16:17,852::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598394', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481726', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:16:17,853::task::1191::Storage.TaskManager.Task::(prepare) Task=`844cce35-e524-4432-b5d6-6b6602c9f8dd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598394', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481726', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:16:17,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`844cce35-e524-4432-b5d6-6b6602c9f8dd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:16:17,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:16:17,853::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:16:17,853::task::993::Storage.TaskManager.Task::(_decref) Task=`844cce35-e524-4432-b5d6-6b6602c9f8dd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:16:22,724::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:16:22,734::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610328 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:16:23,077::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:23,086::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632824 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:16:32,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:16:32,758::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079117 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:32,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b83ecfa-f37d-4bd0-97c7-c7c3ad12ca11`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:16:32,968::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:16:32,969::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632824', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079117', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:16:32,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b83ecfa-f37d-4bd0-97c7-c7c3ad12ca11`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632824', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079117', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:16:32,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b83ecfa-f37d-4bd0-97c7-c7c3ad12ca11`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:16:32,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:16:32,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:16:32,969::task::993::Storage.TaskManager.Task::(_decref) Task=`4b83ecfa-f37d-4bd0-97c7-c7c3ad12ca11`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:16:33,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:33,097::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643732 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:16:42,768::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:16:42,776::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696956 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:16:43,098::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:43,107::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592014 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:16:48,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c3a8b73-e6a3-41ec-8f42-956c6d2e39b4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:16:48,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:16:48,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592014', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696956', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:16:48,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c3a8b73-e6a3-41ec-8f42-956c6d2e39b4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592014', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696956', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:16:48,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c3a8b73-e6a3-41ec-8f42-956c6d2e39b4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:16:48,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:16:48,080::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:16:48,080::task::993::Storage.TaskManager.Task::(_decref) Task=`2c3a8b73-e6a3-41ec-8f42-956c6d2e39b4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:16:52,781::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:16:52,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703474 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:16:53,110::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:16:53,119::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000926656 s, 4.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:17:02,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:17:02,815::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690482 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:17:03,123::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:17:03,131::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667772 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:17:03,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9d0bf13-f950-4ba0-aa0f-cd2d63f23569`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:17:03,204::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:17:03,204::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667772', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690482', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:17:03,205::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9d0bf13-f950-4ba0-aa0f-cd2d63f23569`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667772', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690482', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:17:03,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9d0bf13-f950-4ba0-aa0f-cd2d63f23569`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:17:03,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:17:03,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:17:03,205::task::993::Storage.TaskManager.Task::(_decref) Task=`a9d0bf13-f950-4ba0-aa0f-cd2d63f23569`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:17:12,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:17:12,833::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000555472 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:17:13,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:17:13,141::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568869 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:17:18,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0976f50-64ad-44ce-a8cc-c3ac33c630de`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:17:18,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:17:18,315::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568869', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555472', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:17:18,315::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0976f50-64ad-44ce-a8cc-c3ac33c630de`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568869', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555472', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:17:18,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0976f50-64ad-44ce-a8cc-c3ac33c630de`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:17:18,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:17:18,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:17:18,315::task::993::Storage.TaskManager.Task::(_decref) Task=`d0976f50-64ad-44ce-a8cc-c3ac33c630de`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:17:22,838::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:17:22,848::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063013 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:17:23,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:17:23,152::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592515 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:17:32,863::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:17:32,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699827 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:17:33,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:17:33,162::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705555 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:17:33,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`8adad3f9-8f74-452b-ace3-6df875beb98d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:17:33,422::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:17:33,422::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705555', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699827', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:17:33,423::task::1191::Storage.TaskManager.Task::(prepare) Task=`8adad3f9-8f74-452b-ace3-6df875beb98d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705555', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699827', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:17:33,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`8adad3f9-8f74-452b-ace3-6df875beb98d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:17:33,423::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:17:33,423::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:17:33,423::task::993::Storage.TaskManager.Task::(_decref) Task=`8adad3f9-8f74-452b-ace3-6df875beb98d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:17:42,883::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:17:42,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637721 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:17:43,164::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:17:43,173::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725452 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:17:48,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5d402e5-7690-4fd0-a614-443f7246eff6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:17:48,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:17:48,529::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725452', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637721', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:17:48,529::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5d402e5-7690-4fd0-a614-443f7246eff6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725452', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637721', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:17:48,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5d402e5-7690-4fd0-a614-443f7246eff6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:17:48,530::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:17:48,530::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:17:48,530::task::993::Storage.TaskManager.Task::(_decref) Task=`d5d402e5-7690-4fd0-a614-443f7246eff6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:17:52,897::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:17:52,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662121 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:17:53,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:17:53,198::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0139916 s, 293 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:18:02,921::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:18:02,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00363311 s, 1.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:18:03,201::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:18:03,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760408 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:03,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`27fc02b9-08ec-4054-954a-4d1514648c34`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:18:03,644::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:18:03,644::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760408', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00363311', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:18:03,644::task::1191::Storage.TaskManager.Task::(prepare) Task=`27fc02b9-08ec-4054-954a-4d1514648c34`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760408', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00363311', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:18:03,644::task::595::Storage.TaskManager.Task::(_updateState) Task=`27fc02b9-08ec-4054-954a-4d1514648c34`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:18:03,644::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:18:03,645::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:18:03,645::task::993::Storage.TaskManager.Task::(_decref) Task=`27fc02b9-08ec-4054-954a-4d1514648c34`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:18:12,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:18:12,955::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.004852 s, 844 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:18:13,210::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:18:13,219::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708066 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:18,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`95391127-b2fb-444c-9540-8ce8138cf868`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:18:18,782::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:18:18,783::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708066', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.004852', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:18:18,783::task::1191::Storage.TaskManager.Task::(prepare) Task=`95391127-b2fb-444c-9540-8ce8138cf868`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708066', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.004852', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:18:18,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`95391127-b2fb-444c-9540-8ce8138cf868`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:18:18,783::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:18:18,783::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:18:18,784::task::993::Storage.TaskManager.Task::(_decref) Task=`95391127-b2fb-444c-9540-8ce8138cf868`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:18:22,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:18:22,971::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601602 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:18:23,222::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:18:23,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704946 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:18:32,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:18:32,993::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00054052 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:18:33,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:18:33,242::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657167 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:33,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`705f5be6-52bf-403a-a221-132659cbb8f3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:18:33,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:18:33,898::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657167', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054052', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:18:33,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`705f5be6-52bf-403a-a221-132659cbb8f3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657167', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054052', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:18:33,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`705f5be6-52bf-403a-a221-132659cbb8f3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:18:33,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:18:33,898::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:18:33,898::task::993::Storage.TaskManager.Task::(_decref) Task=`705f5be6-52bf-403a-a221-132659cbb8f3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:18:43,015::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:18:43,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607676 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:18:43,244::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:18:43,253::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701394 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:48,872::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [793131cb] >Thread-15::DEBUG::2014-08-12 18:18:48,873::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e0924bd-c0eb-41e4-9157-5ea3abdc0b45`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:18:48,873::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:18:48,875::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 18:18:48,877::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=7,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-28::DEBUG::2014-08-12 18:18:49,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`c452250f-62c3-4753-a9bc-cad2588fec69`::moving from state init -> state preparing >Thread-28::INFO::2014-08-12 18:18:49,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-08-12 18:18:49,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701394', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607676', 'lastCheck': '6.0', 'valid': True}} >Thread-28::DEBUG::2014-08-12 18:18:49,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`c452250f-62c3-4753-a9bc-cad2588fec69`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701394', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607676', 'lastCheck': '6.0', 'valid': True}} >Thread-28::DEBUG::2014-08-12 18:18:49,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`c452250f-62c3-4753-a9bc-cad2588fec69`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-08-12 18:18:49,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-08-12 18:18:49,013::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-08-12 18:18:49,013::task::993::Storage.TaskManager.Task::(_decref) Task=`c452250f-62c3-4753-a9bc-cad2588fec69`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:18:53,028::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:18:53,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568886 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:18:53,255::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:18:53,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059178 s, 6.9 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 18:18:53,930::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:18:53,930::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 18:18:53,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:18:53,930::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 18:18:53,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:18:53,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:18:53,931::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:18:53,931::__init__::225::IOProcess::(_processLogs) (270) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:18:53,931::__init__::225::IOProcess::(_processLogs) (270) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:18:53,932::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(270) Building response >Thread-29::DEBUG::2014-08-12 18:18:53,932::__init__::225::IOProcess::(_processLogs) (270) Queuing response >Thread-29::DEBUG::2014-08-12 18:18:53,932::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 18:18:53,933::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:18:53,939::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:18:53,939::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:18:53,940::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:18:53,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:18:53,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:18:53,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:18:53,940::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:18:53,940::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:18:53,940::__init__::225::IOProcess::(_processLogs) (271) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:18:53,941::__init__::225::IOProcess::(_processLogs) (271) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:18:53,941::__init__::225::IOProcess::(_processLogs) (271) Queuing response >Thread-15::DEBUG::2014-08-12 18:18:53,941::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'880b1e00-85c8-4296-8d02-a32c1d378a1f',) >Thread-29::DEBUG::2014-08-12 18:18:53,942::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:18:53,943::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 18:18:53,943::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 18:18:53,944::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:18:53,944::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e0924bd-c0eb-41e4-9157-5ea3abdc0b45`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:18:53,944::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e0924bd-c0eb-41e4-9157-5ea3abdc0b45`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:18:53,945::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:18:53,945::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:18:53,945::task::993::Storage.TaskManager.Task::(_decref) Task=`5e0924bd-c0eb-41e4-9157-5ea3abdc0b45`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:18:54,155::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 18:18:54,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`bee682b0-6f77-4f1f-bbde-7aab63a6e03d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:18:54,156::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 18:18:54,156::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`3c6a9495-b438-457f-9435-aed7531f31fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 18:18:54,157::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 18:18:54,157::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 18:18:54,157::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`3c6a9495-b438-457f-9435-aed7531f31fe`::Granted request >Thread-15::DEBUG::2014-08-12 18:18:54,157::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8d5512d3-344c-4ae7-b475-8bb3f2208846`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 18:18:54,158::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 18:18:54,158::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 18:18:54,158::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8d5512d3-344c-4ae7-b475-8bb3f2208846`::Granted request >Thread-15::DEBUG::2014-08-12 18:18:54,158::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 18:18:54,158::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::DEBUG::2014-08-12 18:18:54,159::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,159::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,159::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,159::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,160::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,160::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,160::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:18:54,160::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:18:54,160::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:18:54,160::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:18:54,161::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:18:54,161::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:54,203::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:18:54,204::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:54,270::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:54,271::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,271::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,271::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,272::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,272::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,272::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,272::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:18:54,272::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,275::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:54,480::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:54,481::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,481::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 18:18:54,482::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:54,490::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000508474 s, 4.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:54,491::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000508474 s, 4.0 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 18:18:54,491::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 18:18:54,491::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 18:18:54,491::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 18:18:54,491::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,492::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,492::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,492::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,492::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,493::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:54,674::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:54,674::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,675::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 18:18:54,676::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 18:18:54,676::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 18:18:54,676::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 18:18:54,676::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 18:18:54,677::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 18:18:54,677::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:18:54,677::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:18:54,677::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 18:18:54,677::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 18:18:54,678::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,678::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:54,856::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:54,857::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:54,857::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 18:18:54,857::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 18:18:54,857::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 18:18:54,857::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 18:18:54,859::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:18:54,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:18:54,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:18:54,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:18:54,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:18:54,860::__init__::225::IOProcess::(_processLogs) (272) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:18:54,860::__init__::225::IOProcess::(_processLogs) (272) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:18:54,861::__init__::225::IOProcess::(_processLogs) (272) Queuing response >Thread-15::INFO::2014-08-12 18:18:54,862::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 18:18:54,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:18:54,863::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 18:18:54,863::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 18:18:54,863::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 18:18:54,864::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 18:18:54,864::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 18:18:54,864::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 18:18:54,864::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 18:18:54,864::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 18:18:54,865::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 18:18:54,865::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 18:18:54,865::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 18:18:54,866::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 18:18:54,866::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:18:54,866::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 18:18:54,866::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 18:18:54,866::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 18:18:54,866::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:18:54,867::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 18:18:54,867::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 18:18:54,867::task::1191::Storage.TaskManager.Task::(prepare) Task=`bee682b0-6f77-4f1f-bbde-7aab63a6e03d`::finished: True >Thread-15::DEBUG::2014-08-12 18:18:54,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`bee682b0-6f77-4f1f-bbde-7aab63a6e03d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:18:54,867::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:18:54,868::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:18:54,868::task::993::Storage.TaskManager.Task::(_decref) Task=`bee682b0-6f77-4f1f-bbde-7aab63a6e03d`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:18:54,889::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4ba03e34] >Thread-15::DEBUG::2014-08-12 18:18:54,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad809768-1ebd-421c-a0b6-2a08e5270fac`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:18:54,890::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:18:54,890::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:54,927::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:18:54,927::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:18:54,927::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:18:54,928::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:18:54,928::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:18:54,928::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:54,961::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:18:54,963::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:18:55,022::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:18:55,023::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:55,023::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:55,023::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:55,023::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:55,024::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:55,024::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:18:55,024::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 18:18:55,024::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:18:55,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad809768-1ebd-421c-a0b6-2a08e5270fac`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:18:55,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad809768-1ebd-421c-a0b6-2a08e5270fac`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:18:55,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:18:55,025::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:18:55,025::task::993::Storage.TaskManager.Task::(_decref) Task=`ad809768-1ebd-421c-a0b6-2a08e5270fac`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:19:03,050::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:19:03,053::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,056::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:03,248::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:19:03,248::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,248::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:19:03,249::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:03,258::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000554826 s, 3.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:19:03,258::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000554826 s, 3.7 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:19:03,259::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:19:03,259::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:19:03,259::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:19:03,259::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,260::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,260::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,260::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,260::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,261::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:03,269::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:19:03,269::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-16::DEBUG::2014-08-12 18:19:03,270::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:03,451::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:03,451::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:19:03,453::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:03,454::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:03,463::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,466::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 18:19:03,466::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000499832 s, 4.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:03,468::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000499832 s, 4.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:19:03,469::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:19:03,470::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::INFO::2014-08-12 18:19:03,472::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::DEBUG::2014-08-12 18:19:03,472::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::INFO::2014-08-12 18:19:03,472::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:19:03,473::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:19:03,475::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:03,475::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:03,484::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:19:03,484::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:19:03,484::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:19:03,485::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:19:03,485::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:03,654::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:19:03,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:03,662::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00048692 s, 8.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:03,666::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:03,666::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:19:03,667::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:19:03,668::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:19:03,668::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:19:03,668::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:19:03,668::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:03,834::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:03,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:03,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00055623 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:19:04,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`27c00c71-e908-44b6-b53f-a62c00f95fc3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:19:04,175::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:19:04,175::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055623', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048692', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:19:04,175::task::1191::Storage.TaskManager.Task::(prepare) Task=`27c00c71-e908-44b6-b53f-a62c00f95fc3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055623', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048692', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:19:04,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`27c00c71-e908-44b6-b53f-a62c00f95fc3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:19:04,176::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:19:04,176::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:19:04,176::task::993::Storage.TaskManager.Task::(_decref) Task=`27c00c71-e908-44b6-b53f-a62c00f95fc3`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:19:09,485::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [67a6467] >Thread-15::DEBUG::2014-08-12 18:19:09,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`17356efa-b6a4-443d-b63b-54ea53dc2afc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:19:09,486::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:19:09,490::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 18:19:09,491::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=7,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 18:19:09,522::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 18:19:09,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,523::__init__::225::IOProcess::(_processLogs) (273) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:19:09,524::__init__::225::IOProcess::(_processLogs) (273) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:19:09,524::__init__::225::IOProcess::(_processLogs) (273) Building response >Thread-29::DEBUG::2014-08-12 18:19:09,524::__init__::225::IOProcess::(_processLogs) (273) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,524::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:19:09,538::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:19:09,539::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:19:09,539::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,539::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,540::__init__::225::IOProcess::(_processLogs) (274) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:19:09,540::__init__::225::IOProcess::(_processLogs) (274) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 18:19:09,541::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'880b1e00-85c8-4296-8d02-a32c1d378a1f',) >Thread-29::DEBUG::2014-08-12 18:19:09,541::__init__::225::IOProcess::(_processLogs) (274) Queuing response >Thread-15::DEBUG::2014-08-12 18:19:09,542::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 18:19:09,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 18:19:09,543::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-29::DEBUG::2014-08-12 18:19:09,543::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 18:19:09,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`17356efa-b6a4-443d-b63b-54ea53dc2afc`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:19:09,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`17356efa-b6a4-443d-b63b-54ea53dc2afc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:19:09,545::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:19:09,545::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:19:09,545::task::993::Storage.TaskManager.Task::(_decref) Task=`17356efa-b6a4-443d-b63b-54ea53dc2afc`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:19:09,560::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [67a6467] >Thread-15::DEBUG::2014-08-12 18:19:09,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`9022c5da-3262-4e9a-a614-78ed3a0c6aec`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:19:09,561::logUtils::44::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='880b1e00-85c8-4296-8d02-a32c1d378a1f', autoDetach=False, options=None) >Thread-15::DEBUG::2014-08-12 18:19:09,561::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:19:09,561::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:19:09,562::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:19:09,562::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:19:09,583::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:19:09,585::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:19:09,663::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:19:09,664::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f`ReqID=`c2a77238-6174-4b25-baf6-962e9579a407`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2741' at 'formatStorageDomain' >Thread-15::DEBUG::2014-08-12 18:19:09,664::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 18:19:09,665::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 18:19:09,665::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f`ReqID=`c2a77238-6174-4b25-baf6-962e9579a407`::Granted request >Thread-15::DEBUG::2014-08-12 18:19:09,665::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9022c5da-3262-4e9a-a614-78ed3a0c6aec`::_resourcesAcquired: Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f (exclusive) >Thread-15::DEBUG::2014-08-12 18:19:09,665::task::993::Storage.TaskManager.Task::(_decref) Task=`9022c5da-3262-4e9a-a614-78ed3a0c6aec`::ref 1 aborting False >Thread-15::DEBUG::2014-08-12 18:19:09,666::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:19:09,666::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:19:09,666::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:19:09,666::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:19:09,666::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:19:09,666::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:19:09,687::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:19:09,688::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:19:09,729::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:19:09,729::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,729::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,730::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,730::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,730::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,730::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,730::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-29::DEBUG::2014-08-12 18:19:09,732::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:19:09,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,732::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:19:09,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,732::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,733::__init__::225::IOProcess::(_processLogs) (275) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:19:09,733::__init__::225::IOProcess::(_processLogs) (275) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:19:09,734::__init__::225::IOProcess::(_processLogs) (275) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,735::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 18:19:09,738::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-29::DEBUG::2014-08-12 18:19:09,738::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 18:19:09,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:19:09,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,739::__init__::225::IOProcess::(_processLogs) (276) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 18:19:09,739::__init__::225::IOProcess::(_processLogs) (276) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 18:19:09,740::__init__::225::IOProcess::(_processLogs) (276) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,740::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:19:09,741::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 18:19:09,741::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:19:09,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,742::__init__::225::IOProcess::(_processLogs) (277) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:19:09,742::__init__::225::IOProcess::(_processLogs) (277) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 18:19:09,743::__init__::225::IOProcess::(_processLogs) (277) Queuing response >Thread-15::DEBUG::2014-08-12 18:19:09,743::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=880b1e00-85c8-4296-8d02-a32c1d378a1f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1f1e3d618d088808e2d3fa469a341ea67efd863e'] >Thread-29::DEBUG::2014-08-12 18:19:09,743::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 18:19:09,745::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 18:19:09,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,746::__init__::225::IOProcess::(_processLogs) (278) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:19:09,746::__init__::225::IOProcess::(_processLogs) (278) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:19:09,746::__init__::225::IOProcess::(_processLogs) (278) Building response >Thread-29::DEBUG::2014-08-12 18:19:09,746::__init__::225::IOProcess::(_processLogs) (278) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,747::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,747::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:19:09,747::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 18:19:09,747::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:19:09,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,748::__init__::225::IOProcess::(_processLogs) (279) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:19:09,748::__init__::225::IOProcess::(_processLogs) (279) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:19:09,748::__init__::225::IOProcess::(_processLogs) (279) Queuing response >Thread-15::DEBUG::2014-08-12 18:19:09,748::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-15::INFO::2014-08-12 18:19:09,749::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 880b1e00-85c8-4296-8d02-a32c1d378a1f_imageNS already registered >Thread-29::DEBUG::2014-08-12 18:19:09,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 18:19:09,750::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 880b1e00-85c8-4296-8d02-a32c1d378a1f_volumeNS already registered >Thread-29::DEBUG::2014-08-12 18:19:09,750::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:19:09,751::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:19:09,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,752::__init__::225::IOProcess::(_processLogs) (280) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:19:09,752::__init__::225::IOProcess::(_processLogs) (280) Got request for method 'readfile' >Thread-15::DEBUG::2014-08-12 18:19:09,752::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=880b1e00-85c8-4296-8d02-a32c1d378a1f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1f1e3d618d088808e2d3fa469a341ea67efd863e'] >Thread-29::DEBUG::2014-08-12 18:19:09,752::__init__::225::IOProcess::(_processLogs) (280) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 18:19:09,754::fileSD::508::Storage.StorageDomain::(format) Formatting domain 880b1e00-85c8-4296-8d02-a32c1d378a1f >Thread-29::DEBUG::2014-08-12 18:19:09,754::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 18:19:09,757::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:19:09,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,757::__init__::225::IOProcess::(_processLogs) (281) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:19:09,758::__init__::225::IOProcess::(_processLogs) (281) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:19:09,758::__init__::225::IOProcess::(_processLogs) (281) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,761::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-29::DEBUG::2014-08-12 18:19:09,764::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:19:09,764::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,764::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,764::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,764::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,765::__init__::225::IOProcess::(_processLogs) (282) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 18:19:09,765::__init__::225::IOProcess::(_processLogs) (282) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 18:19:09,765::__init__::225::IOProcess::(_processLogs) (282) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,766::__init__::225::IOProcess::(_processLogs) Sending response sized 101 >Thread-29::DEBUG::2014-08-12 18:19:09,766::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 18:19:09,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:19:09,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,767::__init__::225::IOProcess::(_processLogs) (283) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:19:09,767::__init__::225::IOProcess::(_processLogs) (283) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:19:09,767::__init__::225::IOProcess::(_processLogs) (283) Building response >Thread-29::DEBUG::2014-08-12 18:19:09,767::__init__::225::IOProcess::(_processLogs) (283) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,768::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 18:19:09,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,769::__init__::225::IOProcess::(_processLogs) (284) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 18:19:09,769::__init__::225::IOProcess::(_processLogs) (284) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 18:19:09,770::__init__::225::IOProcess::(_processLogs) (284) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,770::__init__::225::IOProcess::(_processLogs) Sending response sized 141 >Thread-29::DEBUG::2014-08-12 18:19:09,771::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 18:19:09,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,772::__init__::225::IOProcess::(_processLogs) (285) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:19:09,772::__init__::225::IOProcess::(_processLogs) (285) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:19:09,772::__init__::225::IOProcess::(_processLogs) (285) Building response >Thread-29::DEBUG::2014-08-12 18:19:09,773::__init__::225::IOProcess::(_processLogs) (285) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,773::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 18:19:09,773::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-29::DEBUG::2014-08-12 18:19:09,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,773::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,774::__init__::225::IOProcess::(_processLogs) (286) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:19:09,774::__init__::225::IOProcess::(_processLogs) (286) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:19:09,775::__init__::225::IOProcess::(_processLogs) (286) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,775::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,775::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:19:09,775::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 18:19:09,775::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,776::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,776::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,776::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,776::__init__::225::IOProcess::(_processLogs) (287) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:19:09,776::__init__::225::IOProcess::(_processLogs) (287) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:19:09,777::__init__::225::IOProcess::(_processLogs) (287) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,777::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,777::__init__::225::IOProcess::(_processLogs) Sending response sized 319 >Thread-29::DEBUG::2014-08-12 18:19:09,778::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 18:19:09,778::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,778::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,778::__init__::225::IOProcess::(_processLogs) (288) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:19:09,779::__init__::225::IOProcess::(_processLogs) (288) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:19:09,779::__init__::225::IOProcess::(_processLogs) (288) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,780::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:19:09,780::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 18:19:09,780::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,781::__init__::225::IOProcess::(_processLogs) (289) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:19:09,781::__init__::225::IOProcess::(_processLogs) (289) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:19:09,781::__init__::225::IOProcess::(_processLogs) (289) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,782::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 18:19:09,782::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 18:19:09,782::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,783::__init__::225::IOProcess::(_processLogs) (290) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:19:09,783::__init__::225::IOProcess::(_processLogs) (290) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:19:09,784::__init__::225::IOProcess::(_processLogs) (290) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,784::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,784::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:19:09,784::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 18:19:09,784::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,785::__init__::225::IOProcess::(_processLogs) (291) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:19:09,785::__init__::225::IOProcess::(_processLogs) (291) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:19:09,786::__init__::225::IOProcess::(_processLogs) (291) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,786::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 18:19:09,787::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 18:19:09,787::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,787::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,787::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,788::__init__::225::IOProcess::(_processLogs) (292) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:19:09,788::__init__::225::IOProcess::(_processLogs) (292) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:19:09,788::__init__::225::IOProcess::(_processLogs) (292) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,789::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:19:09,789::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 18:19:09,789::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,790::__init__::225::IOProcess::(_processLogs) (293) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:19:09,790::__init__::225::IOProcess::(_processLogs) (293) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:19:09,791::__init__::225::IOProcess::(_processLogs) (293) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,791::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,791::__init__::225::IOProcess::(_processLogs) Sending response sized 315 >Thread-29::DEBUG::2014-08-12 18:19:09,791::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-29::DEBUG::2014-08-12 18:19:09,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,792::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,792::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,792::__init__::225::IOProcess::(_processLogs) (294) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 18:19:09,792::__init__::225::IOProcess::(_processLogs) (294) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 18:19:09,793::__init__::225::IOProcess::(_processLogs) (294) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,793::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,793::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:19:09,793::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 18:19:09,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,794::__init__::225::IOProcess::(_processLogs) (295) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 18:19:09,794::__init__::225::IOProcess::(_processLogs) (295) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 18:19:09,795::__init__::225::IOProcess::(_processLogs) (295) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,795::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:19:09,796::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 18:19:09,796::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,796::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,796::__init__::225::IOProcess::(_processLogs) (296) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 18:19:09,797::__init__::225::IOProcess::(_processLogs) (296) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 18:19:09,797::__init__::225::IOProcess::(_processLogs) (296) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,798::__init__::225::IOProcess::(_processLogs) Sending response sized 315 >Thread-29::DEBUG::2014-08-12 18:19:09,798::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 18:19:09,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,798::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,799::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,799::__init__::225::IOProcess::(_processLogs) (297) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 18:19:09,799::__init__::225::IOProcess::(_processLogs) (297) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 18:19:09,799::__init__::225::IOProcess::(_processLogs) (297) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,800::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:19:09,800::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 18:19:09,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,801::__init__::225::IOProcess::(_processLogs) (298) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 18:19:09,801::__init__::225::IOProcess::(_processLogs) (298) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 18:19:09,801::__init__::225::IOProcess::(_processLogs) (298) Queuing response >Thread-29::DEBUG::2014-08-12 18:19:09,802::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:19:09,802::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:19:09,802::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-29::DEBUG::2014-08-12 18:19:09,802::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:19:09,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:19:09,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:19:09,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:19:09,803::__init__::225::IOProcess::(_processLogs) (299) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 18:19:09,803::__init__::225::IOProcess::(_processLogs) (299) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 18:19:09,804::__init__::225::IOProcess::(_processLogs) (299) Queuing response >Thread-15::INFO::2014-08-12 18:19:09,804::logUtils::47::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-29::DEBUG::2014-08-12 18:19:09,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:19:09,805::task::1191::Storage.TaskManager.Task::(prepare) Task=`9022c5da-3262-4e9a-a614-78ed3a0c6aec`::finished: None >Thread-29::DEBUG::2014-08-12 18:19:09,805::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:19:09,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`9022c5da-3262-4e9a-a614-78ed3a0c6aec`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:19:09,806::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f': < ResourceRef 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 18:19:09,806::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:19:09,806::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' >Thread-15::DEBUG::2014-08-12 18:19:09,806::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' (0 active users) >Thread-15::DEBUG::2014-08-12 18:19:09,806::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:19:09,807::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.880b1e00-85c8-4296-8d02-a32c1d378a1f', Clearing records. >Thread-15::DEBUG::2014-08-12 18:19:09,807::task::993::Storage.TaskManager.Task::(_decref) Task=`9022c5da-3262-4e9a-a614-78ed3a0c6aec`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:19:09,869::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [16f2e835] >Thread-15::DEBUG::2014-08-12 18:19:09,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`d826e165-65be-4e40-bd62-99c7f25847a5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:19:09,869::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}], options=None) >Thread-15::DEBUG::2014-08-12 18:19:09,870::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 18:19:09,913::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:19:09,914::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:19:09,914::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:19:09,914::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:19:09,914::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:19:09,914::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:19:09,936::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:19:09,937::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:19:09,978::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:19:09,978::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,979::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,979::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,979::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,979::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,979::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:19:09,980::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 18:19:09,980::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:19:09,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`d826e165-65be-4e40-bd62-99c7f25847a5`::finished: {'statuslist': [{'status': 0, 'id': '4d6e8c9d-bac3-4e71-b86e-fde695908ade'}]} >Thread-15::DEBUG::2014-08-12 18:19:09,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`d826e165-65be-4e40-bd62-99c7f25847a5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:19:09,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:19:09,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:19:09,981::task::993::Storage.TaskManager.Task::(_decref) Task=`d826e165-65be-4e40-bd62-99c7f25847a5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:19:13,666::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:19:13,668::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:13,845::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-16::DEBUG::2014-08-12 18:19:13,845::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:13,889::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:19:13,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:13,898::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698606 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:14,033::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:14,034::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:19:14,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:14,043::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552206 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:19:19,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b5ec26c-4c42-44ec-a03f-a694f7754223`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:19:19,291::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:19:19,292::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552206', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698606', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:19:19,292::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b5ec26c-4c42-44ec-a03f-a694f7754223`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552206', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698606', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:19:19,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b5ec26c-4c42-44ec-a03f-a694f7754223`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:19:19,292::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:19:19,292::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:19:19,292::task::993::Storage.TaskManager.Task::(_decref) Task=`0b5ec26c-4c42-44ec-a03f-a694f7754223`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:19:23,905::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:23,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071738 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:24,044::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:24,053::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069727 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:19:33,918::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:33,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622822 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:34,054::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:34,063::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651637 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:19:34,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`24506e11-6943-404e-bee4-288f49104019`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:19:34,398::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:19:34,398::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651637', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622822', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:19:34,398::task::1191::Storage.TaskManager.Task::(prepare) Task=`24506e11-6943-404e-bee4-288f49104019`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651637', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622822', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:19:34,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`24506e11-6943-404e-bee4-288f49104019`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:19:34,399::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:19:34,399::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:19:34,399::task::993::Storage.TaskManager.Task::(_decref) Task=`24506e11-6943-404e-bee4-288f49104019`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:19:43,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:43,938::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598303 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:44,064::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:44,074::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059909 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:19:49,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`4987d5ce-5eb1-459d-9d9f-b6bdbc9741d6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:19:49,506::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:19:49,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059909', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598303', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:19:49,507::task::1191::Storage.TaskManager.Task::(prepare) Task=`4987d5ce-5eb1-459d-9d9f-b6bdbc9741d6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059909', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598303', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:19:49,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`4987d5ce-5eb1-459d-9d9f-b6bdbc9741d6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:19:49,507::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:19:49,507::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:19:49,507::task::993::Storage.TaskManager.Task::(_decref) Task=`4987d5ce-5eb1-459d-9d9f-b6bdbc9741d6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:19:53,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:19:53,950::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720201 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:19:54,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:19:54,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528858 s, 7.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:20:03,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:20:03,963::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701002 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:20:04,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:20:04,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114751 s, 3.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:20:04,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`31365201-1bad-446c-9a7a-3e92876e51cf`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:20:04,619::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:20:04,620::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114751', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701002', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:20:04,620::task::1191::Storage.TaskManager.Task::(prepare) Task=`31365201-1bad-446c-9a7a-3e92876e51cf`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114751', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701002', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:20:04,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`31365201-1bad-446c-9a7a-3e92876e51cf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:20:04,620::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:20:04,620::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:20:04,620::task::993::Storage.TaskManager.Task::(_decref) Task=`31365201-1bad-446c-9a7a-3e92876e51cf`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:20:13,967::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:20:13,975::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604199 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:20:14,094::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:20:14,103::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548988 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:20:19,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7e283bd-a173-4a5b-846c-c04ef5230c27`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:20:19,735::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:20:19,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548988', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604199', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:20:19,736::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7e283bd-a173-4a5b-846c-c04ef5230c27`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548988', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604199', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:20:19,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7e283bd-a173-4a5b-846c-c04ef5230c27`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:20:19,736::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:20:19,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:20:19,736::task::993::Storage.TaskManager.Task::(_decref) Task=`b7e283bd-a173-4a5b-846c-c04ef5230c27`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:20:23,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:20:23,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693671 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:20:24,105::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:20:24,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616656 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:20:33,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:20:33,999::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668976 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:20:34,115::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:20:34,122::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072149 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:20:34,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`82a06013-0f07-41f4-ad3a-65f8f8c2d408`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:20:34,860::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:20:34,861::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072149', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668976', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:20:34,861::task::1191::Storage.TaskManager.Task::(prepare) Task=`82a06013-0f07-41f4-ad3a-65f8f8c2d408`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072149', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668976', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:20:34,861::task::595::Storage.TaskManager.Task::(_updateState) Task=`82a06013-0f07-41f4-ad3a-65f8f8c2d408`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:20:34,861::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:20:34,861::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:20:34,861::task::993::Storage.TaskManager.Task::(_decref) Task=`82a06013-0f07-41f4-ad3a-65f8f8c2d408`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:20:44,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:20:44,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580054 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:20:44,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:20:44,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702106 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:20:49,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4efc4f9-6dfc-4a2a-9b9a-b24cb2006101`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:20:49,968::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:20:49,969::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702106', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580054', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:20:49,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4efc4f9-6dfc-4a2a-9b9a-b24cb2006101`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702106', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580054', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:20:49,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4efc4f9-6dfc-4a2a-9b9a-b24cb2006101`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:20:49,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:20:49,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:20:49,970::task::993::Storage.TaskManager.Task::(_decref) Task=`e4efc4f9-6dfc-4a2a-9b9a-b24cb2006101`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:20:54,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:20:54,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725773 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:20:54,134::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:20:54,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000867945 s, 4.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:21:04,026::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:21:04,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000773223 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:21:04,144::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:21:04,151::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000783397 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:21:05,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7ca0121-f84f-47ae-ab12-e409e0e3f07d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:21:05,080::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:21:05,081::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783397', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773223', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:21:05,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7ca0121-f84f-47ae-ab12-e409e0e3f07d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783397', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773223', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:21:05,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7ca0121-f84f-47ae-ab12-e409e0e3f07d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:21:05,081::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:21:05,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:21:05,082::task::993::Storage.TaskManager.Task::(_decref) Task=`e7ca0121-f84f-47ae-ab12-e409e0e3f07d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:21:14,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:21:14,046::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000529634 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:21:14,153::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:21:14,162::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000512965 s, 8.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:21:20,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a323b01-9f7c-4d02-91f6-ef32aeb1baa1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:21:20,190::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:21:20,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512965', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529634', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:21:20,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a323b01-9f7c-4d02-91f6-ef32aeb1baa1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512965', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529634', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:21:20,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a323b01-9f7c-4d02-91f6-ef32aeb1baa1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:21:20,191::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:21:20,191::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:21:20,192::task::993::Storage.TaskManager.Task::(_decref) Task=`0a323b01-9f7c-4d02-91f6-ef32aeb1baa1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:21:24,054::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:21:24,062::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730414 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:21:24,164::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:21:24,172::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602629 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:21:34,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:21:34,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727057 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:21:34,173::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:21:34,181::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000736035 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:21:35,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`dacf8748-ec9c-4286-bfc4-6513c52d37ba`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:21:35,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:21:35,303::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000736035', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727057', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:21:35,303::task::1191::Storage.TaskManager.Task::(prepare) Task=`dacf8748-ec9c-4286-bfc4-6513c52d37ba`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000736035', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727057', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:21:35,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`dacf8748-ec9c-4286-bfc4-6513c52d37ba`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:21:35,303::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:21:35,303::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:21:35,304::task::993::Storage.TaskManager.Task::(_decref) Task=`dacf8748-ec9c-4286-bfc4-6513c52d37ba`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:21:44,078::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:21:44,086::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000508083 s, 8.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:21:44,182::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:21:44,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066646 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:21:50,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fa22a2f-482f-4cca-a507-4fabc67e3f29`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:21:50,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:21:50,410::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066646', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508083', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:21:50,411::task::1191::Storage.TaskManager.Task::(prepare) Task=`6fa22a2f-482f-4cca-a507-4fabc67e3f29`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066646', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508083', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:21:50,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fa22a2f-482f-4cca-a507-4fabc67e3f29`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:21:50,411::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:21:50,411::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:21:50,411::task::993::Storage.TaskManager.Task::(_decref) Task=`6fa22a2f-482f-4cca-a507-4fabc67e3f29`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:21:54,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:21:54,098::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714355 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:21:54,192::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:21:54,200::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567445 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:22:04,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:22:04,109::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000723314 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:22:04,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:22:04,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737523 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:22:05,527::task::595::Storage.TaskManager.Task::(_updateState) Task=`3985f9a9-661a-4298-803c-644188b01325`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:22:05,527::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:22:05,528::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737523', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723314', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:22:05,528::task::1191::Storage.TaskManager.Task::(prepare) Task=`3985f9a9-661a-4298-803c-644188b01325`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737523', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723314', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:22:05,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`3985f9a9-661a-4298-803c-644188b01325`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:22:05,528::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:22:05,528::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:22:05,528::task::993::Storage.TaskManager.Task::(_decref) Task=`3985f9a9-661a-4298-803c-644188b01325`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:22:14,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:22:14,121::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00054521 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:22:14,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:22:14,219::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690858 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:22:20,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`db0283fb-eb74-4e31-840a-e2b4373b9db1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:22:20,637::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:22:20,637::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690858', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054521', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:22:20,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`db0283fb-eb74-4e31-840a-e2b4373b9db1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690858', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054521', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:22:20,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`db0283fb-eb74-4e31-840a-e2b4373b9db1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:22:20,638::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:22:20,638::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:22:20,638::task::993::Storage.TaskManager.Task::(_decref) Task=`db0283fb-eb74-4e31-840a-e2b4373b9db1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:22:24,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:22:24,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717929 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:22:24,221::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:22:24,242::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0130121 s, 315 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:22:34,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:22:34,144::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720084 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:22:34,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:22:34,252::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554194 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:22:35,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7693ab0-bc11-4142-8a98-189e88a38af1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:22:35,745::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:22:35,745::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554194', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720084', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:22:35,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7693ab0-bc11-4142-8a98-189e88a38af1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554194', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720084', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:22:35,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7693ab0-bc11-4142-8a98-189e88a38af1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:22:35,746::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:22:35,746::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:22:35,746::task::993::Storage.TaskManager.Task::(_decref) Task=`a7693ab0-bc11-4142-8a98-189e88a38af1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:22:44,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:22:44,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060017 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:22:44,254::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:22:44,262::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569259 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:22:50,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`5db14805-7a67-45d4-83a8-007e3f5f95de`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:22:50,855::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:22:50,855::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569259', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060017', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:22:50,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`5db14805-7a67-45d4-83a8-007e3f5f95de`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569259', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060017', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:22:50,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`5db14805-7a67-45d4-83a8-007e3f5f95de`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:22:50,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:22:50,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:22:50,856::task::993::Storage.TaskManager.Task::(_decref) Task=`5db14805-7a67-45d4-83a8-007e3f5f95de`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:22:54,158::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:22:54,167::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659597 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:22:54,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:22:54,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058767 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:23:04,170::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:23:04,178::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671065 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:23:04,274::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:23:04,282::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591285 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:23:05,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c284b7f-31f2-440f-ac6a-ea80c47db51b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:23:05,969::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:23:05,969::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591285', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671065', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:23:05,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c284b7f-31f2-440f-ac6a-ea80c47db51b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591285', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671065', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:23:05,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c284b7f-31f2-440f-ac6a-ea80c47db51b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:23:05,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:23:05,970::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:23:05,970::task::993::Storage.TaskManager.Task::(_decref) Task=`8c284b7f-31f2-440f-ac6a-ea80c47db51b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:23:14,182::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:23:14,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000526074 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:23:14,284::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:23:14,293::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753507 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:23:21,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`90b3d62f-2222-43d1-a08d-a3d9484ac620`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:23:21,088::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:23:21,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753507', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526074', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:23:21,090::task::1191::Storage.TaskManager.Task::(prepare) Task=`90b3d62f-2222-43d1-a08d-a3d9484ac620`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753507', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526074', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:23:21,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`90b3d62f-2222-43d1-a08d-a3d9484ac620`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:23:21,091::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:23:21,092::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:23:21,093::task::993::Storage.TaskManager.Task::(_decref) Task=`90b3d62f-2222-43d1-a08d-a3d9484ac620`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:23:24,193::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:23:24,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065081 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:23:24,295::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:23:24,302::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568741 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:23:34,206::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:23:34,214::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729504 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:23:34,304::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:23:34,311::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000526244 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:23:36,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3e28995-78aa-496e-acd5-a09b8d4daec3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:23:36,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:23:36,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526244', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729504', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:23:36,201::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3e28995-78aa-496e-acd5-a09b8d4daec3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526244', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729504', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:23:36,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3e28995-78aa-496e-acd5-a09b8d4daec3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:23:36,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:23:36,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:23:36,201::task::993::Storage.TaskManager.Task::(_decref) Task=`b3e28995-78aa-496e-acd5-a09b8d4daec3`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:23:44,217::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:23:44,226::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594772 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:23:44,312::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:23:44,321::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063251 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:23:51,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`d07243fc-1629-4351-9cef-3b7b612d97a4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:23:51,305::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:23:51,305::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063251', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594772', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:23:51,305::task::1191::Storage.TaskManager.Task::(prepare) Task=`d07243fc-1629-4351-9cef-3b7b612d97a4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063251', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594772', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:23:51,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`d07243fc-1629-4351-9cef-3b7b612d97a4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:23:51,305::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:23:51,305::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:23:51,306::task::993::Storage.TaskManager.Task::(_decref) Task=`d07243fc-1629-4351-9cef-3b7b612d97a4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:23:54,229::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:23:54,237::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668479 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:23:54,322::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:23:54,331::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618751 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:24:04,240::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:24:04,240::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:24:04,240::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:24:04,248::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000634109 s, 3.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:24:04,249::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000634109 s, 3.2 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:24:04,249::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:24:04,249::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:24:04,249::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:24:04,250::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:24:04,250::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:24:04,250::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:24:04,250::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:24:04,251::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:24:04,251::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:04,332::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:24:04,333::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:24:04,334::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:04,345::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000590722 s, 3.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:04,345::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000590722 s, 3.5 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:24:04,346::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:24:04,346::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:24:04,346::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:24:04,346::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 18:24:04,517::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:24:04,518::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:24:04,519::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 18:24:04,519::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:24:04,522::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 18:24:04,523::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:24:04,524::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:24:04,525::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:24:04,525::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:24:04,527::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:04,527::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:24:04,536::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:24:04,536::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:24:04,702::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:24:04,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:24:04,712::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000503225 s, 8.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:04,714::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:04,717::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:24:04,719::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:24:04,721::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:24:04,721::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:24:04,723::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:24:04,726::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:04,894::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:04,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:04,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583508 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:24:06,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`f239a480-acb7-41cc-acdc-2e67e1d0b1d7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:24:06,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:24:06,428::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583508', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503225', 'lastCheck': '1.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:24:06,428::task::1191::Storage.TaskManager.Task::(prepare) Task=`f239a480-acb7-41cc-acdc-2e67e1d0b1d7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583508', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503225', 'lastCheck': '1.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:24:06,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`f239a480-acb7-41cc-acdc-2e67e1d0b1d7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:24:06,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:24:06,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:24:06,429::task::993::Storage.TaskManager.Task::(_decref) Task=`f239a480-acb7-41cc-acdc-2e67e1d0b1d7`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:24:14,736::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:24:14,744::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000507274 s, 8.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:14,904::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:14,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000744404 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:24:21,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6665085-49f7-4131-927f-e11d8d18ac40`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:24:21,553::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:24:21,554::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744404', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507274', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:24:21,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6665085-49f7-4131-927f-e11d8d18ac40`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000744404', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507274', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:24:21,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6665085-49f7-4131-927f-e11d8d18ac40`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:24:21,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:24:21,554::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:24:21,554::task::993::Storage.TaskManager.Task::(_decref) Task=`c6665085-49f7-4131-927f-e11d8d18ac40`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:24:24,748::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:24:24,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000488675 s, 8.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:24,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:24,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000775424 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:24:34,759::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:24:34,767::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683993 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:34,924::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:34,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625754 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:24:36,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`85c37db0-a990-4c22-a880-5134b24dfe60`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:24:36,683::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:24:36,683::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625754', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683993', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:24:36,683::task::1191::Storage.TaskManager.Task::(prepare) Task=`85c37db0-a990-4c22-a880-5134b24dfe60`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625754', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683993', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:24:36,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`85c37db0-a990-4c22-a880-5134b24dfe60`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:24:36,684::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:24:36,684::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:24:36,684::task::993::Storage.TaskManager.Task::(_decref) Task=`85c37db0-a990-4c22-a880-5134b24dfe60`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:24:44,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:24:44,779::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656049 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:44,934::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:44,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564189 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:24:51,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`409914eb-ae3c-4346-88da-20b7ab3aea6e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:24:51,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:24:51,794::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564189', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656049', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:24:51,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`409914eb-ae3c-4346-88da-20b7ab3aea6e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564189', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656049', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:24:51,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`409914eb-ae3c-4346-88da-20b7ab3aea6e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:24:51,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:24:51,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:24:51,795::task::993::Storage.TaskManager.Task::(_decref) Task=`409914eb-ae3c-4346-88da-20b7ab3aea6e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:24:54,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:24:54,790::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687611 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:24:54,943::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:24:54,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621905 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:25:04,794::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:25:04,802::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000849852 s, 4.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:25:04,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:25:04,961::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564655 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:25:06,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`653fa0eb-c357-4c45-9c68-88652468ce1b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:25:06,924::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:25:06,925::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564655', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000849852', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:25:06,925::task::1191::Storage.TaskManager.Task::(prepare) Task=`653fa0eb-c357-4c45-9c68-88652468ce1b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564655', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000849852', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:25:06,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`653fa0eb-c357-4c45-9c68-88652468ce1b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:25:06,925::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:25:06,925::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:25:06,925::task::993::Storage.TaskManager.Task::(_decref) Task=`653fa0eb-c357-4c45-9c68-88652468ce1b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:25:14,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:25:14,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596667 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:25:14,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:25:14,971::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688719 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:25:22,033::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b72e658-0e0c-4c9b-8392-31c8c969a110`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:25:22,034::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:25:22,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000688719', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596667', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:25:22,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b72e658-0e0c-4c9b-8392-31c8c969a110`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000688719', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596667', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:25:22,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b72e658-0e0c-4c9b-8392-31c8c969a110`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:25:22,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:25:22,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:25:22,035::task::993::Storage.TaskManager.Task::(_decref) Task=`6b72e658-0e0c-4c9b-8392-31c8c969a110`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:25:24,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:25:24,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710456 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:25:24,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:25:24,981::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712592 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:25:34,829::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:25:34,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000559955 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:25:34,982::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:25:34,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558943 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:25:37,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`45e3dcce-89a4-482a-a373-395c1f87bbed`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:25:37,150::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:25:37,150::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558943', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559955', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:25:37,150::task::1191::Storage.TaskManager.Task::(prepare) Task=`45e3dcce-89a4-482a-a373-395c1f87bbed`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558943', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559955', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:25:37,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`45e3dcce-89a4-482a-a373-395c1f87bbed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:25:37,151::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:25:37,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:25:37,151::task::993::Storage.TaskManager.Task::(_decref) Task=`45e3dcce-89a4-482a-a373-395c1f87bbed`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:25:44,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:25:44,848::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000435705 s, 9.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:25:44,991::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:25:45,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603696 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:25:52,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`45c99e09-aa3b-4d4d-86be-14b1339ada59`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:25:52,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:25:52,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603696', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435705', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:25:52,260::task::1191::Storage.TaskManager.Task::(prepare) Task=`45c99e09-aa3b-4d4d-86be-14b1339ada59`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603696', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435705', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:25:52,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`45c99e09-aa3b-4d4d-86be-14b1339ada59`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:25:52,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:25:52,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:25:52,260::task::993::Storage.TaskManager.Task::(_decref) Task=`45c99e09-aa3b-4d4d-86be-14b1339ada59`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:25:54,852::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:25:54,860::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708674 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:25:55,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:25:55,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579196 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:26:04,863::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:26:04,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700141 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:26:05,011::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:26:05,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757827 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:26:07,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d5af9bb-822c-461f-a66b-7c57dcb61de1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:26:07,376::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:26:07,376::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757827', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700141', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:26:07,376::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d5af9bb-822c-461f-a66b-7c57dcb61de1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757827', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700141', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:26:07,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d5af9bb-822c-461f-a66b-7c57dcb61de1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:26:07,377::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:26:07,377::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:26:07,377::task::993::Storage.TaskManager.Task::(_decref) Task=`9d5af9bb-822c-461f-a66b-7c57dcb61de1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:26:14,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:26:14,883::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581126 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:26:15,020::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:26:15,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600661 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:26:22,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`27296f7f-0205-42cc-818b-40bf5b4d8920`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:26:22,490::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:26:22,491::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600661', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581126', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:26:22,492::task::1191::Storage.TaskManager.Task::(prepare) Task=`27296f7f-0205-42cc-818b-40bf5b4d8920`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600661', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581126', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:26:22,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`27296f7f-0205-42cc-818b-40bf5b4d8920`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:26:22,492::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:26:22,493::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:26:22,493::task::993::Storage.TaskManager.Task::(_decref) Task=`27296f7f-0205-42cc-818b-40bf5b4d8920`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:26:24,887::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:26:24,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00820599 s, 499 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:26:25,031::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:26:25,039::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590482 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:26:34,905::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:26:34,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594903 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:26:35,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:26:35,048::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735737 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:26:37,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`d39a4555-a381-4221-96df-b2ccbcf5a77f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:26:37,615::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:26:37,615::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735737', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594903', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:26:37,615::task::1191::Storage.TaskManager.Task::(prepare) Task=`d39a4555-a381-4221-96df-b2ccbcf5a77f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735737', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594903', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:26:37,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`d39a4555-a381-4221-96df-b2ccbcf5a77f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:26:37,615::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:26:37,616::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:26:37,616::task::993::Storage.TaskManager.Task::(_decref) Task=`d39a4555-a381-4221-96df-b2ccbcf5a77f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:26:44,916::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:26:44,925::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667449 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:26:45,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:26:45,062::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656406 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:26:52,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`e444ab17-857f-4934-9420-4d6ff995372e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:26:52,730::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:26:52,731::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656406', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667449', 'lastCheck': '7.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:26:52,732::task::1191::Storage.TaskManager.Task::(prepare) Task=`e444ab17-857f-4934-9420-4d6ff995372e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656406', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667449', 'lastCheck': '7.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:26:52,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`e444ab17-857f-4934-9420-4d6ff995372e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:26:52,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:26:52,733::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:26:52,734::task::993::Storage.TaskManager.Task::(_decref) Task=`e444ab17-857f-4934-9420-4d6ff995372e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:26:54,928::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:26:54,937::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759444 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:26:55,064::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:26:55,072::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632953 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:27:04,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:27:04,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685788 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:27:05,074::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:27:05,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722386 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:27:07,859::task::595::Storage.TaskManager.Task::(_updateState) Task=`64564f38-9fb2-409a-afd0-f7a080a9a20c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:27:07,860::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:27:07,860::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722386', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685788', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:27:07,860::task::1191::Storage.TaskManager.Task::(prepare) Task=`64564f38-9fb2-409a-afd0-f7a080a9a20c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722386', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685788', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:27:07,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`64564f38-9fb2-409a-afd0-f7a080a9a20c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:27:07,861::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:27:07,861::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:27:07,861::task::993::Storage.TaskManager.Task::(_decref) Task=`64564f38-9fb2-409a-afd0-f7a080a9a20c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:27:14,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:27:14,959::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060047 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:27:15,084::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:27:15,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661769 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:27:23,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7027c45-e846-45c6-8713-c4fe7f2e6aac`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:27:23,044::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:27:23,045::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661769', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060047', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:27:23,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7027c45-e846-45c6-8713-c4fe7f2e6aac`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661769', 'lastCheck': '8.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060047', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:27:23,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7027c45-e846-45c6-8713-c4fe7f2e6aac`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:27:23,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:27:23,047::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:27:23,047::task::993::Storage.TaskManager.Task::(_decref) Task=`e7027c45-e846-45c6-8713-c4fe7f2e6aac`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:27:24,963::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:27:24,971::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067174 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:27:25,094::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:27:25,102::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606595 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:27:34,974::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:27:34,983::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000556626 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:27:35,104::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:27:35,112::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643345 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:27:38,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c39b0fd-57e8-4487-aad7-63d402b69672`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:27:38,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:27:38,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643345', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556626', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:27:38,169::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c39b0fd-57e8-4487-aad7-63d402b69672`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643345', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556626', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:27:38,170::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c39b0fd-57e8-4487-aad7-63d402b69672`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:27:38,170::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:27:38,170::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:27:38,170::task::993::Storage.TaskManager.Task::(_decref) Task=`2c39b0fd-57e8-4487-aad7-63d402b69672`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:27:44,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:27:44,995::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636046 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:27:45,114::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:27:45,122::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632429 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:27:53,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d543184-1da5-4347-9317-3d53c60a5116`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:27:53,318::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:27:53,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632429', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636046', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:27:53,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d543184-1da5-4347-9317-3d53c60a5116`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632429', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636046', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:27:53,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d543184-1da5-4347-9317-3d53c60a5116`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:27:53,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:27:53,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:27:53,321::task::993::Storage.TaskManager.Task::(_decref) Task=`7d543184-1da5-4347-9317-3d53c60a5116`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:27:54,998::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:27:55,007::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725117 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:27:55,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:27:55,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564273 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:28:05,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:28:05,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658674 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:28:05,134::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:28:05,141::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666155 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:28:08,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8fe35ad-c4d7-4951-b510-6fb053992e4a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:28:08,437::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:28:08,437::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666155', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658674', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:28:08,437::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8fe35ad-c4d7-4951-b510-6fb053992e4a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666155', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658674', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:28:08,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8fe35ad-c4d7-4951-b510-6fb053992e4a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:28:08,438::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:28:08,438::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:28:08,438::task::993::Storage.TaskManager.Task::(_decref) Task=`e8fe35ad-c4d7-4951-b510-6fb053992e4a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:28:15,022::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:28:15,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642224 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:28:15,142::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:28:15,149::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647967 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:28:23,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`8135a342-9e09-423f-a00c-dda56cc421cd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:28:23,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:28:23,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647967', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642224', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:28:23,555::task::1191::Storage.TaskManager.Task::(prepare) Task=`8135a342-9e09-423f-a00c-dda56cc421cd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647967', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642224', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:28:23,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`8135a342-9e09-423f-a00c-dda56cc421cd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:28:23,555::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:28:23,556::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:28:23,556::task::993::Storage.TaskManager.Task::(_decref) Task=`8135a342-9e09-423f-a00c-dda56cc421cd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:28:25,046::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:28:25,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662234 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:28:25,151::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:28:25,159::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645952 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:28:35,059::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:28:35,067::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066172 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:28:35,162::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:28:35,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581376 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:28:38,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd4b8a37-30ab-4e8c-a69d-bbc5bbacf4e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:28:38,664::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:28:38,665::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581376', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066172', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:28:38,665::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd4b8a37-30ab-4e8c-a69d-bbc5bbacf4e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581376', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066172', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:28:38,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd4b8a37-30ab-4e8c-a69d-bbc5bbacf4e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:28:38,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:28:38,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:28:38,665::task::993::Storage.TaskManager.Task::(_decref) Task=`cd4b8a37-30ab-4e8c-a69d-bbc5bbacf4e5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:28:45,070::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:28:45,078::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636628 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:28:45,172::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:28:45,181::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633002 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:28:53,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f112867-4da3-4938-b03c-63a1da685fcb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:28:53,779::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:28:53,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633002', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636628', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:28:53,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f112867-4da3-4938-b03c-63a1da685fcb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633002', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636628', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:28:53,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f112867-4da3-4938-b03c-63a1da685fcb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:28:53,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:28:53,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:28:53,780::task::993::Storage.TaskManager.Task::(_decref) Task=`1f112867-4da3-4938-b03c-63a1da685fcb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:28:55,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:28:55,090::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716154 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:28:55,182::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:28:55,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618747 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:29:05,093::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:29:05,094::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:29:05,094::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:29:05,102::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00075472 s, 2.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:29:05,102::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00075472 s, 2.7 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:29:05,103::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:29:05,103::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:29:05,103::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:29:05,103::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:29:05,104::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:29:05,104::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:29:05,104::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:29:05,104::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:29:05,105::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:05,192::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:29:05,193::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:29:05,193::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:05,202::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000629814 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:05,202::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000629814 s, 3.3 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:29:05,202::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:29:05,202::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:29:05,203::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:29:05,203::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 18:29:05,393::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:29:05,394::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:29:05,395::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 18:29:05,395::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:29:05,398::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 18:29:05,399::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:29:05,400::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:29:05,401::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:29:05,401::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:29:05,403::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:05,411::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:29:05,412::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:29:05,412::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:29:05,570::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:29:05,571::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:29:05,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000492178 s, 8.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:05,590::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:05,591::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:29:05,591::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:29:05,592::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:29:05,592::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:29:05,592::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:29:05,593::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:05,758::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:05,759::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:05,768::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062186 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:29:08,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`2abecbce-8e71-44f6-82cb-66ccdec794ce`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:29:08,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:29:08,889::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062186', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492178', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:29:08,889::task::1191::Storage.TaskManager.Task::(prepare) Task=`2abecbce-8e71-44f6-82cb-66ccdec794ce`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062186', 'lastCheck': '3.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492178', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:29:08,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`2abecbce-8e71-44f6-82cb-66ccdec794ce`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:29:08,890::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:29:08,890::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:29:08,890::task::993::Storage.TaskManager.Task::(_decref) Task=`2abecbce-8e71-44f6-82cb-66ccdec794ce`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:29:15,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:29:15,590::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635931 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:15,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:15,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619372 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:29:24,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`98bedc58-780e-4796-993d-9b47c71e2a8b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:29:24,009::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:29:24,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619372', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635931', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:29:24,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`98bedc58-780e-4796-993d-9b47c71e2a8b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619372', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635931', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:29:24,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`98bedc58-780e-4796-993d-9b47c71e2a8b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:29:24,010::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:29:24,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:29:24,011::task::993::Storage.TaskManager.Task::(_decref) Task=`98bedc58-780e-4796-993d-9b47c71e2a8b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:29:25,594::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:29:25,602::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630278 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:25,779::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:25,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708521 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:29:35,605::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:29:35,614::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756734 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:35,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:35,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740772 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:29:39,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`51eddd34-29f9-419b-a4c7-b74076f2123e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:29:39,126::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:29:39,126::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740772', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756734', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:29:39,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`51eddd34-29f9-419b-a4c7-b74076f2123e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740772', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756734', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:29:39,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`51eddd34-29f9-419b-a4c7-b74076f2123e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:29:39,127::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:29:39,127::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:29:39,127::task::993::Storage.TaskManager.Task::(_decref) Task=`51eddd34-29f9-419b-a4c7-b74076f2123e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:29:45,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:29:45,625::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622795 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:45,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:45,808::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699046 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:29:54,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9cb4a7a-a16c-4bc6-b6ec-20d973786a2b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:29:54,230::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:29:54,230::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699046', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622795', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:29:54,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9cb4a7a-a16c-4bc6-b6ec-20d973786a2b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699046', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622795', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:29:54,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9cb4a7a-a16c-4bc6-b6ec-20d973786a2b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:29:54,231::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:29:54,231::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:29:54,231::task::993::Storage.TaskManager.Task::(_decref) Task=`e9cb4a7a-a16c-4bc6-b6ec-20d973786a2b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:29:55,629::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:29:55,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640859 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:29:55,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:29:55,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627853 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:30:05,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:30:05,649::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623962 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:30:05,827::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:30:05,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00811038 s, 505 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:30:09,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0dcdc26-4894-4a57-afb1-21b4195c94ef`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:30:09,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:30:09,387::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00811038', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623962', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:30:09,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0dcdc26-4894-4a57-afb1-21b4195c94ef`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00811038', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623962', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:30:09,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0dcdc26-4894-4a57-afb1-21b4195c94ef`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:30:09,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:30:09,387::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:30:09,388::task::993::Storage.TaskManager.Task::(_decref) Task=`d0dcdc26-4894-4a57-afb1-21b4195c94ef`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:30:15,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:30:15,661::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000546302 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:30:15,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:30:15,852::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660935 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:30:24,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`f24da96e-fb10-4823-b462-f9e303124c44`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:30:24,497::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:30:24,497::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660935', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546302', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:30:24,497::task::1191::Storage.TaskManager.Task::(prepare) Task=`f24da96e-fb10-4823-b462-f9e303124c44`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660935', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546302', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:30:24,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`f24da96e-fb10-4823-b462-f9e303124c44`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:30:24,497::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:30:24,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:30:24,498::task::993::Storage.TaskManager.Task::(_decref) Task=`f24da96e-fb10-4823-b462-f9e303124c44`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:30:25,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:30:25,673::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060733 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:30:25,854::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:30:25,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619823 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:30:35,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:30:35,685::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650766 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:30:35,864::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:30:35,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679518 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:30:39,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`67326fc3-a330-472f-9375-485aa5f0f10b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:30:39,627::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:30:39,628::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679518', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650766', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:30:39,628::task::1191::Storage.TaskManager.Task::(prepare) Task=`67326fc3-a330-472f-9375-485aa5f0f10b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679518', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650766', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:30:39,628::task::595::Storage.TaskManager.Task::(_updateState) Task=`67326fc3-a330-472f-9375-485aa5f0f10b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:30:39,628::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:30:39,628::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:30:39,629::task::993::Storage.TaskManager.Task::(_decref) Task=`67326fc3-a330-472f-9375-485aa5f0f10b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:30:45,688::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:30:45,697::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066901 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:30:45,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:30:45,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657107 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:30:54,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd336084-6de2-486d-b7a3-38fa2fcef59d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:30:54,736::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:30:54,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657107', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066901', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:30:54,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd336084-6de2-486d-b7a3-38fa2fcef59d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657107', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066901', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:30:54,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd336084-6de2-486d-b7a3-38fa2fcef59d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:30:54,737::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:30:54,737::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:30:54,737::task::993::Storage.TaskManager.Task::(_decref) Task=`bd336084-6de2-486d-b7a3-38fa2fcef59d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:30:55,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:30:55,711::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644111 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:30:55,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:30:55,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605848 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:31:05,714::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:31:05,722::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625977 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:31:05,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:31:05,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544886 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:31:09,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`85b6ef89-7c17-4041-a266-bd5def04b698`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:31:09,840::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:31:09,841::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544886', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625977', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:31:09,841::task::1191::Storage.TaskManager.Task::(prepare) Task=`85b6ef89-7c17-4041-a266-bd5def04b698`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544886', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625977', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:31:09,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`85b6ef89-7c17-4041-a266-bd5def04b698`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:31:09,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:31:09,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:31:09,842::task::993::Storage.TaskManager.Task::(_decref) Task=`85b6ef89-7c17-4041-a266-bd5def04b698`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:31:15,726::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:31:15,734::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588895 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:31:15,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:31:15,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580441 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:31:24,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6684a5c-aad9-4095-9d99-cab68d171993`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:31:24,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:31:24,949::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580441', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588895', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:31:24,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`d6684a5c-aad9-4095-9d99-cab68d171993`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580441', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588895', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:31:24,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6684a5c-aad9-4095-9d99-cab68d171993`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:31:24,949::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:31:24,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:31:24,950::task::993::Storage.TaskManager.Task::(_decref) Task=`d6684a5c-aad9-4095-9d99-cab68d171993`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:31:25,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:31:25,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068505 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:31:25,914::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:31:25,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639208 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:31:35,748::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:31:35,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648209 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:31:35,924::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:31:35,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000761121 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:31:40,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`602ed589-8812-4603-b64a-284ab64ceef4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:31:40,073::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:31:40,073::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761121', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648209', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:31:40,073::task::1191::Storage.TaskManager.Task::(prepare) Task=`602ed589-8812-4603-b64a-284ab64ceef4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761121', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648209', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:31:40,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`602ed589-8812-4603-b64a-284ab64ceef4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:31:40,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:31:40,074::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:31:40,074::task::993::Storage.TaskManager.Task::(_decref) Task=`602ed589-8812-4603-b64a-284ab64ceef4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:31:45,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:31:45,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630185 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:31:45,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:31:45,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730271 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:31:55,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`f61dbda0-b783-43b2-8821-5f48ae19057f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:31:55,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:31:55,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730271', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630185', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:31:55,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`f61dbda0-b783-43b2-8821-5f48ae19057f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730271', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630185', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:31:55,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`f61dbda0-b783-43b2-8821-5f48ae19057f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:31:55,195::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:31:55,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:31:55,195::task::993::Storage.TaskManager.Task::(_decref) Task=`f61dbda0-b783-43b2-8821-5f48ae19057f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:31:55,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:31:55,781::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663226 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:31:55,943::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:31:55,951::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548629 s, 7.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:32:05,784::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:32:05,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677613 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:32:05,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:32:05,960::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646919 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:32:10,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`f54cfbea-166b-4b30-b222-3aa46015a798`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:32:10,301::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:32:10,301::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646919', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677613', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:32:10,301::task::1191::Storage.TaskManager.Task::(prepare) Task=`f54cfbea-166b-4b30-b222-3aa46015a798`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646919', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677613', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:32:10,301::task::595::Storage.TaskManager.Task::(_updateState) Task=`f54cfbea-166b-4b30-b222-3aa46015a798`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:32:10,302::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:32:10,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:32:10,302::task::993::Storage.TaskManager.Task::(_decref) Task=`f54cfbea-166b-4b30-b222-3aa46015a798`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:32:15,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:32:15,804::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714467 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:32:15,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:32:15,970::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664111 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:32:25,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`62574cb4-e592-4f34-90f7-8528a610908f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:32:25,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:32:25,415::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664111', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714467', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:32:25,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`62574cb4-e592-4f34-90f7-8528a610908f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664111', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714467', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:32:25,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`62574cb4-e592-4f34-90f7-8528a610908f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:32:25,415::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:32:25,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:32:25,415::task::993::Storage.TaskManager.Task::(_decref) Task=`62574cb4-e592-4f34-90f7-8528a610908f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:32:25,808::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:32:25,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683544 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:32:25,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:32:25,980::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602278 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:32:35,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:32:35,827::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580207 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:32:35,982::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:32:35,989::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00053311 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:32:40,527::task::595::Storage.TaskManager.Task::(_updateState) Task=`0eaa7c99-54b1-4ab4-aea6-0cdf76ee3d1e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:32:40,527::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:32:40,528::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053311', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580207', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:32:40,528::task::1191::Storage.TaskManager.Task::(prepare) Task=`0eaa7c99-54b1-4ab4-aea6-0cdf76ee3d1e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053311', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580207', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:32:40,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`0eaa7c99-54b1-4ab4-aea6-0cdf76ee3d1e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:32:40,528::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:32:40,528::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:32:40,528::task::993::Storage.TaskManager.Task::(_decref) Task=`0eaa7c99-54b1-4ab4-aea6-0cdf76ee3d1e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:32:45,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:32:45,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601358 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:32:45,991::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:32:45,999::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663966 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:32:55,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbe20abb-9bbc-4254-9508-6dc9f67eb745`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:32:55,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:32:55,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663966', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601358', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:32:55,640::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbe20abb-9bbc-4254-9508-6dc9f67eb745`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663966', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601358', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:32:55,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbe20abb-9bbc-4254-9508-6dc9f67eb745`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:32:55,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:32:55,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:32:55,641::task::993::Storage.TaskManager.Task::(_decref) Task=`fbe20abb-9bbc-4254-9508-6dc9f67eb745`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:32:55,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:32:55,851::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611907 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:32:56,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:32:56,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057698 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:33:05,854::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:33:05,863::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639585 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:33:06,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:33:06,018::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000724002 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:33:10,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5479b75-6d9f-4c59-b8bd-27e260b1f56a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:33:10,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:33:10,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000724002', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639585', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:33:10,748::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5479b75-6d9f-4c59-b8bd-27e260b1f56a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000724002', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639585', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:33:10,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5479b75-6d9f-4c59-b8bd-27e260b1f56a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:33:10,748::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:33:10,748::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:33:10,749::task::993::Storage.TaskManager.Task::(_decref) Task=`b5479b75-6d9f-4c59-b8bd-27e260b1f56a`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:33:15,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:33:15,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00052831 s, 7.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:33:16,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:33:16,027::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621141 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:33:25,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`d84819b7-9719-46bd-9b0b-6da9ac5ccc04`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:33:25,857::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:33:25,858::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621141', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052831', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:33:25,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`d84819b7-9719-46bd-9b0b-6da9ac5ccc04`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621141', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052831', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:33:25,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`d84819b7-9719-46bd-9b0b-6da9ac5ccc04`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:33:25,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:33:25,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:33:25,859::task::993::Storage.TaskManager.Task::(_decref) Task=`d84819b7-9719-46bd-9b0b-6da9ac5ccc04`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:33:25,878::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:33:25,888::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007032 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:33:26,030::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:33:26,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622373 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:33:35,899::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:33:35,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061022 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:33:36,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:33:36,047::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729257 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:33:40,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbb350ac-e46f-4830-a8ef-cf7516ab5520`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:33:40,978::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:33:40,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729257', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061022', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:33:40,978::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbb350ac-e46f-4830-a8ef-cf7516ab5520`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729257', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061022', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:33:40,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbb350ac-e46f-4830-a8ef-cf7516ab5520`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:33:40,978::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:33:40,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:33:40,979::task::993::Storage.TaskManager.Task::(_decref) Task=`bbb350ac-e46f-4830-a8ef-cf7516ab5520`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:33:45,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:33:45,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633819 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:33:46,049::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:33:46,057::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625966 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:33:55,924::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:33:55,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666113 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:33:56,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:33:56,067::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00055026 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:33:56,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`b08bf0bb-f40b-4ea1-ae88-f7e91393dc91`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:33:56,088::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:33:56,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055026', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666113', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:33:56,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`b08bf0bb-f40b-4ea1-ae88-f7e91393dc91`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055026', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666113', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:33:56,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`b08bf0bb-f40b-4ea1-ae88-f7e91393dc91`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:33:56,089::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:33:56,089::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:33:56,090::task::993::Storage.TaskManager.Task::(_decref) Task=`b08bf0bb-f40b-4ea1-ae88-f7e91393dc91`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:34:05,935::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:34:05,935::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:34:05,936::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:34:05,944::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000643672 s, 3.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:34:05,944::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000643672 s, 3.2 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:34:05,944::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:34:05,944::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:34:05,945::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:34:05,945::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:34:05,945::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:34:05,946::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:34:05,946::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:34:05,946::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:34:05,946::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:06,068::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:34:06,069::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:34:06,069::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:06,079::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00072019 s, 2.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:34:06,079::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00072019 s, 2.8 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:34:06,079::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:34:06,080::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:34:06,080::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:34:06,080::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 18:34:06,258::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:34:06,258::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:34:06,259::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 18:34:06,260::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 18:34:06,263::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::DEBUG::2014-08-12 18:34:06,263::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 18:34:06,263::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:34:06,264::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:34:06,266::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:34:06,266::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:06,275::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:34:06,276::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:34:06,276::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:34:06,443::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:34:06,443::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:34:06,453::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533866 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:34:06,455::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:34:06,458::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:34:06,460::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:34:06,466::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:34:06,467::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:34:06,468::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:34:06,469::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:06,637::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:34:06,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:06,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698073 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:34:11,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`9530f9d9-be0d-48d6-bab1-803c243cb9cc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:34:11,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:34:11,206::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698073', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533866', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:34:11,206::task::1191::Storage.TaskManager.Task::(prepare) Task=`9530f9d9-be0d-48d6-bab1-803c243cb9cc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698073', 'lastCheck': '4.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533866', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:34:11,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`9530f9d9-be0d-48d6-bab1-803c243cb9cc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:34:11,206::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:34:11,206::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:34:11,207::task::993::Storage.TaskManager.Task::(_decref) Task=`9530f9d9-be0d-48d6-bab1-803c243cb9cc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:34:16,470::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:34:16,478::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659715 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:34:16,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:16,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653271 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:34:26,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`d50b2bcd-1a99-43c4-9158-cc8aa9686a9f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:34:26,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:34:26,321::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653271', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659715', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:34:26,322::task::1191::Storage.TaskManager.Task::(prepare) Task=`d50b2bcd-1a99-43c4-9158-cc8aa9686a9f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653271', 'lastCheck': '9.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659715', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:34:26,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`d50b2bcd-1a99-43c4-9158-cc8aa9686a9f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:34:26,322::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:34:26,322::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:34:26,322::task::993::Storage.TaskManager.Task::(_decref) Task=`d50b2bcd-1a99-43c4-9158-cc8aa9686a9f`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:34:26,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:34:26,489::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720197 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:34:26,657::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:26,667::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062596 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:34:36,493::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:34:36,500::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729134 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:34:36,668::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:36,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675511 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:34:41,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`1871abdb-7c9a-4e5b-b215-31c4aa8285ce`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:34:41,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:34:41,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675511', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729134', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:34:41,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`1871abdb-7c9a-4e5b-b215-31c4aa8285ce`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675511', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729134', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:34:41,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`1871abdb-7c9a-4e5b-b215-31c4aa8285ce`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:34:41,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:34:41,435::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:34:41,435::task::993::Storage.TaskManager.Task::(_decref) Task=`1871abdb-7c9a-4e5b-b215-31c4aa8285ce`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:34:46,504::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:34:46,512::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000539068 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:34:46,677::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:46,685::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727505 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:34:56,516::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:34:56,523::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700522 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:34:56,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6491b43-ad43-4622-8e69-89bf2fec5a31`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:34:56,544::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:34:56,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727505', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700522', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:34:56,545::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6491b43-ad43-4622-8e69-89bf2fec5a31`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727505', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700522', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:34:56,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6491b43-ad43-4622-8e69-89bf2fec5a31`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:34:56,545::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:34:56,545::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:34:56,545::task::993::Storage.TaskManager.Task::(_decref) Task=`a6491b43-ad43-4622-8e69-89bf2fec5a31`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:34:56,686::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:34:56,695::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058319 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:35:06,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:35:06,534::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701681 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:35:06,697::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:35:06,704::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064957 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:35:11,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`24ad070d-1273-4308-b7e3-8cacbc0b90ee`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:35:11,667::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:35:11,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064957', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701681', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:35:11,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`24ad070d-1273-4308-b7e3-8cacbc0b90ee`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064957', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701681', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:35:11,668::task::595::Storage.TaskManager.Task::(_updateState) Task=`24ad070d-1273-4308-b7e3-8cacbc0b90ee`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:35:11,668::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:35:11,668::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:35:11,668::task::993::Storage.TaskManager.Task::(_decref) Task=`24ad070d-1273-4308-b7e3-8cacbc0b90ee`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:35:16,537::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:35:16,546::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000556355 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:35:16,706::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:35:16,714::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682457 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:35:26,550::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:35:26,558::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754304 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:35:26,716::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:35:26,724::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610582 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:35:26,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f2c8147-0846-4c6c-a1dc-c85609f49260`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:35:26,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:35:26,787::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610582', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754304', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:35:26,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f2c8147-0846-4c6c-a1dc-c85609f49260`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610582', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754304', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:35:26,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f2c8147-0846-4c6c-a1dc-c85609f49260`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:35:26,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:35:26,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:35:26,788::task::993::Storage.TaskManager.Task::(_decref) Task=`2f2c8147-0846-4c6c-a1dc-c85609f49260`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:35:36,561::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:35:36,569::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000834096 s, 4.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:35:36,725::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:35:36,733::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000861331 s, 4.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:35:41,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b129061-f6ae-4fb3-9af8-b4a4bad2ce2e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:35:41,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:35:41,890::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000861331', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000834096', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:35:41,890::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b129061-f6ae-4fb3-9af8-b4a4bad2ce2e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000861331', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000834096', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:35:41,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b129061-f6ae-4fb3-9af8-b4a4bad2ce2e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:35:41,890::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:35:41,890::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:35:41,890::task::993::Storage.TaskManager.Task::(_decref) Task=`8b129061-f6ae-4fb3-9af8-b4a4bad2ce2e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:35:46,572::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:35:46,581::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698259 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:35:46,734::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:35:46,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624576 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:35:56,584::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:35:56,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720093 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:35:56,743::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:35:56,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548639 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:35:56,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`be066c28-720d-4402-b18e-81593c3b5a46`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:35:56,998::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:35:56,999::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548639', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720093', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:35:56,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`be066c28-720d-4402-b18e-81593c3b5a46`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548639', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720093', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:35:56,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`be066c28-720d-4402-b18e-81593c3b5a46`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:35:56,999::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:35:56,999::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:35:57,000::task::993::Storage.TaskManager.Task::(_decref) Task=`be066c28-720d-4402-b18e-81593c3b5a46`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:36:06,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:36:06,603::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732424 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:36:06,754::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:36:06,761::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721799 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:36:12,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`0217e6e1-27ac-4ca8-8bc2-7dbda640ddca`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:36:12,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:36:12,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721799', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732424', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:36:12,147::task::1191::Storage.TaskManager.Task::(prepare) Task=`0217e6e1-27ac-4ca8-8bc2-7dbda640ddca`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000721799', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732424', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:36:12,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`0217e6e1-27ac-4ca8-8bc2-7dbda640ddca`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:36:12,147::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:36:12,148::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:36:12,148::task::993::Storage.TaskManager.Task::(_decref) Task=`0217e6e1-27ac-4ca8-8bc2-7dbda640ddca`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:36:16,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:36:16,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572817 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:36:16,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:36:16,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650532 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:36:26,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:36:26,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616409 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:36:26,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:36:26,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645714 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:36:27,253::task::595::Storage.TaskManager.Task::(_updateState) Task=`10d05b62-e018-4a42-8239-7ce6929e0c2b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:36:27,253::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:36:27,253::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645714', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616409', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:36:27,253::task::1191::Storage.TaskManager.Task::(prepare) Task=`10d05b62-e018-4a42-8239-7ce6929e0c2b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645714', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616409', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:36:27,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`10d05b62-e018-4a42-8239-7ce6929e0c2b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:36:27,254::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:36:27,254::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:36:27,254::task::993::Storage.TaskManager.Task::(_decref) Task=`10d05b62-e018-4a42-8239-7ce6929e0c2b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:36:36,629::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:36:36,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718849 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:36:36,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:36:36,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742214 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:36:42,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`04cb1e0c-28dc-4a5d-8000-e32c0df47dbc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:36:42,380::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:36:42,380::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742214', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718849', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:36:42,380::task::1191::Storage.TaskManager.Task::(prepare) Task=`04cb1e0c-28dc-4a5d-8000-e32c0df47dbc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742214', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718849', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:36:42,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`04cb1e0c-28dc-4a5d-8000-e32c0df47dbc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:36:42,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:36:42,380::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:36:42,381::task::993::Storage.TaskManager.Task::(_decref) Task=`04cb1e0c-28dc-4a5d-8000-e32c0df47dbc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:36:46,640::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:36:46,649::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645737 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:36:46,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:36:46,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662159 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:36:56,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:36:56,660::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725227 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:36:56,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:36:56,809::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571825 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:36:57,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ec33a9b-a4f8-473d-ba40-0e8c693896ac`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:36:57,487::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:36:57,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571825', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725227', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:36:57,488::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ec33a9b-a4f8-473d-ba40-0e8c693896ac`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571825', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725227', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:36:57,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ec33a9b-a4f8-473d-ba40-0e8c693896ac`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:36:57,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:36:57,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:36:57,489::task::993::Storage.TaskManager.Task::(_decref) Task=`1ec33a9b-a4f8-473d-ba40-0e8c693896ac`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:37:06,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:37:06,671::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754388 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:37:06,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:37:06,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756218 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:37:12,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`15bbf3e6-c51a-47d0-ae61-677e45d2abac`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:37:12,606::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:37:12,607::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756218', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754388', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:37:12,607::task::1191::Storage.TaskManager.Task::(prepare) Task=`15bbf3e6-c51a-47d0-ae61-677e45d2abac`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756218', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754388', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:37:12,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`15bbf3e6-c51a-47d0-ae61-677e45d2abac`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:37:12,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:37:12,609::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:37:12,609::task::993::Storage.TaskManager.Task::(_decref) Task=`15bbf3e6-c51a-47d0-ae61-677e45d2abac`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:37:16,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:37:16,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065269 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:37:16,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:37:16,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617761 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:37:26,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:37:26,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765535 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:37:26,828::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:37:26,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737187 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:37:27,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`79c31186-991b-40c3-8325-af8cc4f76022`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:37:27,743::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:37:27,743::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737187', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765535', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:37:27,743::task::1191::Storage.TaskManager.Task::(prepare) Task=`79c31186-991b-40c3-8325-af8cc4f76022`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737187', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765535', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:37:27,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`79c31186-991b-40c3-8325-af8cc4f76022`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:37:27,743::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:37:27,744::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:37:27,744::task::993::Storage.TaskManager.Task::(_decref) Task=`79c31186-991b-40c3-8325-af8cc4f76022`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:37:36,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:37:36,714::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658541 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:37:36,838::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:37:36,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661508 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:37:42,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`f08de9ac-5027-4916-9954-f972a9710463`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:37:42,852::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:37:42,852::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661508', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658541', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:37:42,852::task::1191::Storage.TaskManager.Task::(prepare) Task=`f08de9ac-5027-4916-9954-f972a9710463`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661508', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658541', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:37:42,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`f08de9ac-5027-4916-9954-f972a9710463`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:37:42,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:37:42,853::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:37:42,853::task::993::Storage.TaskManager.Task::(_decref) Task=`f08de9ac-5027-4916-9954-f972a9710463`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:37:46,718::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:37:46,726::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675155 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:37:46,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:37:46,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695748 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:37:56,730::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:37:56,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718922 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:37:56,857::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:37:56,865::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548379 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:37:57,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a611fa6-f54e-4c49-a57d-13f27cb55fc4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:37:57,965::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:37:57,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548379', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718922', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:37:57,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a611fa6-f54e-4c49-a57d-13f27cb55fc4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548379', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718922', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:37:57,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a611fa6-f54e-4c49-a57d-13f27cb55fc4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:37:57,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:37:57,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:37:57,966::task::993::Storage.TaskManager.Task::(_decref) Task=`2a611fa6-f54e-4c49-a57d-13f27cb55fc4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:38:06,740::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:38:06,748::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656174 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:38:06,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:38:06,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729146 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:38:13,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`656e4102-4ea0-4339-b274-43ba9ba84180`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:38:13,076::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:38:13,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729146', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656174', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:38:13,077::task::1191::Storage.TaskManager.Task::(prepare) Task=`656e4102-4ea0-4339-b274-43ba9ba84180`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729146', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656174', 'lastCheck': '6.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:38:13,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`656e4102-4ea0-4339-b274-43ba9ba84180`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:38:13,077::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:38:13,077::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:38:13,078::task::993::Storage.TaskManager.Task::(_decref) Task=`656e4102-4ea0-4339-b274-43ba9ba84180`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:38:16,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:38:16,761::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000542511 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:38:16,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:38:16,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647646 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:38:26,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:38:26,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686787 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:38:26,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:38:26,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599814 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:38:28,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`94cba6ab-c092-4d2f-ac83-b25c033aa8a6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:38:28,183::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:38:28,183::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599814', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686787', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:38:28,183::task::1191::Storage.TaskManager.Task::(prepare) Task=`94cba6ab-c092-4d2f-ac83-b25c033aa8a6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599814', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686787', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:38:28,183::task::595::Storage.TaskManager.Task::(_updateState) Task=`94cba6ab-c092-4d2f-ac83-b25c033aa8a6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:38:28,184::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:38:28,184::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:38:28,184::task::993::Storage.TaskManager.Task::(_decref) Task=`94cba6ab-c092-4d2f-ac83-b25c033aa8a6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:38:36,775::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:38:36,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639042 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:38:36,894::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:38:36,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737002 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:38:43,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`2814d1bd-1e4d-4f34-96fd-4ca129bfd9fb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:38:43,284::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:38:43,284::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737002', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639042', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:38:43,285::task::1191::Storage.TaskManager.Task::(prepare) Task=`2814d1bd-1e4d-4f34-96fd-4ca129bfd9fb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737002', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639042', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:38:43,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`2814d1bd-1e4d-4f34-96fd-4ca129bfd9fb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:38:43,285::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:38:43,285::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:38:43,285::task::993::Storage.TaskManager.Task::(_decref) Task=`2814d1bd-1e4d-4f34-96fd-4ca129bfd9fb`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:38:46,786::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:38:46,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665183 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:38:46,903::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:38:46,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667504 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:38:56,798::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:38:56,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696167 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:38:56,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:38:56,921::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000537819 s, 7.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:38:58,396::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e0e0bdc-c0d8-462f-a28c-c751c5b634b5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:38:58,396::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:38:58,397::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537819', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696167', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:38:58,397::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e0e0bdc-c0d8-462f-a28c-c751c5b634b5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537819', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696167', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:38:58,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e0e0bdc-c0d8-462f-a28c-c751c5b634b5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:38:58,397::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:38:58,397::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:38:58,397::task::993::Storage.TaskManager.Task::(_decref) Task=`9e0e0bdc-c0d8-462f-a28c-c751c5b634b5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:39:06,815::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:39:06,816::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:39:06,816::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:39:06,824::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000614678 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:39:06,824::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000614678 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:39:06,824::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:39:06,825::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:39:06,825::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:39:06,825::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:39:06,825::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:39:06,826::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:39:06,826::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:39:06,826::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:39:06,826::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:06,923::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:39:06,923::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:39:06,924::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:06,932::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000638174 s, 3.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:06,933::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000638174 s, 3.2 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:39:06,933::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:39:06,933::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:39:06,933::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:39:06,933::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 18:39:07,089::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:39:07,089::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:39:07,090::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:39:07,090::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 18:39:07,092::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 18:39:07,095::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-16::DEBUG::2014-08-12 18:39:07,096::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::INFO::2014-08-12 18:39:07,096::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:39:07,097::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:39:07,098::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:39:07,099::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:07,108::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:39:07,109::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:39:07,273::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:39:07,274::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:39:07,282::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000429894 s, 9.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:07,289::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:07,290::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:39:07,290::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:39:07,291::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:39:07,291::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:39:07,291::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:39:07,291::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:07,459::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:07,460::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:07,468::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596506 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:39:13,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`f83ee628-c97e-4e33-89dd-dd7d69430989`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:39:13,507::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:39:13,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596506', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429894', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:39:13,507::task::1191::Storage.TaskManager.Task::(prepare) Task=`f83ee628-c97e-4e33-89dd-dd7d69430989`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596506', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429894', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:39:13,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`f83ee628-c97e-4e33-89dd-dd7d69430989`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:39:13,508::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:39:13,508::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:39:13,508::task::993::Storage.TaskManager.Task::(_decref) Task=`f83ee628-c97e-4e33-89dd-dd7d69430989`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:39:17,285::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:39:17,293::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533961 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:17,470::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:17,478::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658103 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:39:27,296::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:39:27,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781719 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:27,480::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:27,488::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630657 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:39:28,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`925428bb-81a3-484d-a973-60433d0c7cd0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:39:28,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:39:28,620::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630657', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781719', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:39:28,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`925428bb-81a3-484d-a973-60433d0c7cd0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630657', 'lastCheck': '1.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781719', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:39:28,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`925428bb-81a3-484d-a973-60433d0c7cd0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:39:28,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:39:28,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:39:28,621::task::993::Storage.TaskManager.Task::(_decref) Task=`925428bb-81a3-484d-a973-60433d0c7cd0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:39:37,310::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:39:37,322::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591114 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:37,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:37,497::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728076 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:39:43,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1461e1d-948a-4888-90f0-0cec10f752fa`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:39:43,724::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:39:43,724::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728076', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591114', 'lastCheck': '6.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:39:43,724::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1461e1d-948a-4888-90f0-0cec10f752fa`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728076', 'lastCheck': '6.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591114', 'lastCheck': '6.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:39:43,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1461e1d-948a-4888-90f0-0cec10f752fa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:39:43,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:39:43,725::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:39:43,725::task::993::Storage.TaskManager.Task::(_decref) Task=`a1461e1d-948a-4888-90f0-0cec10f752fa`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:39:47,326::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:39:47,334::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000545649 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:47,498::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:47,506::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728804 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:39:57,337::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:39:57,346::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715878 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:39:57,508::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:39:57,517::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590491 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:39:58,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`120090cb-7065-4b17-9f06-2c4badae8192`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:39:58,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:39:58,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590491', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715878', 'lastCheck': '1.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:39:58,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`120090cb-7065-4b17-9f06-2c4badae8192`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590491', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715878', 'lastCheck': '1.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:39:58,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`120090cb-7065-4b17-9f06-2c4badae8192`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:39:58,844::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:39:58,844::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:39:58,844::task::993::Storage.TaskManager.Task::(_decref) Task=`120090cb-7065-4b17-9f06-2c4badae8192`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:40:07,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:40:07,357::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634813 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:40:07,518::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:40:07,532::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00714078 s, 574 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:40:13,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9711a15-036d-47c5-ab27-cde09e3e3ac0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:40:13,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:40:13,960::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00714078', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634813', 'lastCheck': '6.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:40:13,960::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9711a15-036d-47c5-ab27-cde09e3e3ac0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00714078', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634813', 'lastCheck': '6.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:40:13,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9711a15-036d-47c5-ab27-cde09e3e3ac0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:40:13,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:40:13,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:40:13,961::task::993::Storage.TaskManager.Task::(_decref) Task=`c9711a15-036d-47c5-ab27-cde09e3e3ac0`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:40:17,362::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:40:17,371::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00078576 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:40:17,533::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:40:17,541::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654201 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:40:27,374::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:40:27,382::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000691305 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:40:27,542::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:40:27,551::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602572 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:40:29,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cde826d-291a-4978-8afe-8c7abc37fcef`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:40:29,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:40:29,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602572', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691305', 'lastCheck': '1.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:40:29,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`2cde826d-291a-4978-8afe-8c7abc37fcef`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602572', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691305', 'lastCheck': '1.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:40:29,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cde826d-291a-4978-8afe-8c7abc37fcef`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:40:29,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:40:29,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:40:29,065::task::993::Storage.TaskManager.Task::(_decref) Task=`2cde826d-291a-4978-8afe-8c7abc37fcef`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:40:37,385::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:40:37,393::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677169 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:40:37,552::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:40:37,559::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716115 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:40:44,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`8a377d0f-c55f-4d0d-9832-3d123bae9a4d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:40:44,191::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:40:44,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716115', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677169', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:40:44,192::task::1191::Storage.TaskManager.Task::(prepare) Task=`8a377d0f-c55f-4d0d-9832-3d123bae9a4d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716115', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677169', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:40:44,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`8a377d0f-c55f-4d0d-9832-3d123bae9a4d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:40:44,192::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:40:44,192::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:40:44,192::task::993::Storage.TaskManager.Task::(_decref) Task=`8a377d0f-c55f-4d0d-9832-3d123bae9a4d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:40:47,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:40:47,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671927 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:40:47,561::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:40:47,569::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567884 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:40:57,409::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:40:57,417::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737332 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:40:57,571::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:40:57,580::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627274 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:40:59,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`7650cc03-f680-4fab-8a37-63d6ecfbff73`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:40:59,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:40:59,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627274', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737332', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:40:59,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`7650cc03-f680-4fab-8a37-63d6ecfbff73`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627274', 'lastCheck': '1.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737332', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:40:59,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`7650cc03-f680-4fab-8a37-63d6ecfbff73`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:40:59,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:40:59,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:40:59,314::task::993::Storage.TaskManager.Task::(_decref) Task=`7650cc03-f680-4fab-8a37-63d6ecfbff73`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:41:07,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:41:07,428::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612291 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:41:07,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:41:07,590::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000570259 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:41:14,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`09a32f83-1f35-48a6-b8d6-e7bc93b02f48`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:41:14,426::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:41:14,426::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570259', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612291', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:41:14,427::task::1191::Storage.TaskManager.Task::(prepare) Task=`09a32f83-1f35-48a6-b8d6-e7bc93b02f48`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570259', 'lastCheck': '6.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612291', 'lastCheck': '7.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:41:14,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`09a32f83-1f35-48a6-b8d6-e7bc93b02f48`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:41:14,427::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:41:14,427::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:41:14,427::task::993::Storage.TaskManager.Task::(_decref) Task=`09a32f83-1f35-48a6-b8d6-e7bc93b02f48`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:41:17,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:41:17,440::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000535266 s, 7.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:41:17,591::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:41:17,600::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000516094 s, 7.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:41:27,443::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:41:27,452::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722672 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:41:27,602::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:41:27,610::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635508 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:41:29,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cf131e5-efa2-4ab8-a1ed-90f9128d9470`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:41:29,544::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:41:29,544::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635508', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722672', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:41:29,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`4cf131e5-efa2-4ab8-a1ed-90f9128d9470`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635508', 'lastCheck': '1.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722672', 'lastCheck': '2.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:41:29,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cf131e5-efa2-4ab8-a1ed-90f9128d9470`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:41:29,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:41:29,545::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:41:29,545::task::993::Storage.TaskManager.Task::(_decref) Task=`4cf131e5-efa2-4ab8-a1ed-90f9128d9470`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:41:37,455::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:41:37,464::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000547179 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:41:37,612::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:41:37,621::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000505334 s, 8.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:41:44,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea901540-9b8b-43b3-9d89-7d7cc449d605`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:41:44,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:41:44,651::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505334', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547179', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:41:44,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea901540-9b8b-43b3-9d89-7d7cc449d605`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505334', 'lastCheck': '7.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547179', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:41:44,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea901540-9b8b-43b3-9d89-7d7cc449d605`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:41:44,651::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:41:44,651::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:41:44,652::task::993::Storage.TaskManager.Task::(_decref) Task=`ea901540-9b8b-43b3-9d89-7d7cc449d605`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:41:47,467::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:41:47,475::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686369 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:41:47,622::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:41:47,631::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000573012 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:41:57,479::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:41:57,487::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752331 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:41:57,633::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:41:57,641::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614678 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:41:59,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b568010-8e80-442d-82d3-e726fbbf65ab`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:41:59,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:41:59,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614678', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752331', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:41:59,754::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b568010-8e80-442d-82d3-e726fbbf65ab`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614678', 'lastCheck': '2.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752331', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:41:59,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b568010-8e80-442d-82d3-e726fbbf65ab`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:41:59,755::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:41:59,755::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:41:59,755::task::993::Storage.TaskManager.Task::(_decref) Task=`9b568010-8e80-442d-82d3-e726fbbf65ab`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:42:07,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:42:07,499::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614969 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:42:07,643::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:42:07,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667927 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:42:14,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1e46d1e-56ad-47ac-bbce-a1f06a1364c9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:42:14,863::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:42:14,863::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667927', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614969', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:42:14,863::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1e46d1e-56ad-47ac-bbce-a1f06a1364c9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667927', 'lastCheck': '7.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614969', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:42:14,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1e46d1e-56ad-47ac-bbce-a1f06a1364c9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:42:14,863::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:42:14,864::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:42:14,864::task::993::Storage.TaskManager.Task::(_decref) Task=`f1e46d1e-56ad-47ac-bbce-a1f06a1364c9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:42:17,503::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:42:17,510::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000541119 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:42:17,653::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:42:17,661::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588765 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:42:27,514::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:42:27,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000733447 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:42:27,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:42:27,671::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636302 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:42:29,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a98cc6d-df78-4c4b-b073-6ed107129661`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:42:29,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:42:29,973::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636302', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000733447', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:42:29,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a98cc6d-df78-4c4b-b073-6ed107129661`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636302', 'lastCheck': '2.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000733447', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:42:29,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a98cc6d-df78-4c4b-b073-6ed107129661`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:42:29,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:42:29,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:42:29,973::task::993::Storage.TaskManager.Task::(_decref) Task=`6a98cc6d-df78-4c4b-b073-6ed107129661`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:42:37,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:42:37,534::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000565051 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:42:37,673::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:42:37,680::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708436 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:42:45,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f7d6303-06fd-4c55-93b3-1992d5174cd2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:42:45,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:42:45,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708436', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565051', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:42:45,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f7d6303-06fd-4c55-93b3-1992d5174cd2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708436', 'lastCheck': '7.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565051', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:42:45,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f7d6303-06fd-4c55-93b3-1992d5174cd2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:42:45,109::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:42:45,109::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:42:45,109::task::993::Storage.TaskManager.Task::(_decref) Task=`7f7d6303-06fd-4c55-93b3-1992d5174cd2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:42:47,545::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:42:47,553::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554522 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:42:47,682::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:42:47,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592661 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:42:57,556::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:42:57,566::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638693 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:42:57,692::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:42:57,699::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578711 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:43:00,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf031dad-0a93-4e49-aa2c-b7b6d699d8ee`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:43:00,211::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:43:00,211::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578711', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638693', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:43:00,211::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf031dad-0a93-4e49-aa2c-b7b6d699d8ee`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578711', 'lastCheck': '2.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638693', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:43:00,211::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf031dad-0a93-4e49-aa2c-b7b6d699d8ee`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:43:00,212::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:43:00,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:43:00,212::task::993::Storage.TaskManager.Task::(_decref) Task=`bf031dad-0a93-4e49-aa2c-b7b6d699d8ee`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:43:07,569::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:43:07,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062947 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:43:07,701::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:43:07,709::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678661 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:43:15,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`57ebf7ce-1265-4a0d-8cfd-1896ba6c084e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:43:15,328::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:43:15,329::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678661', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062947', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:43:15,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`57ebf7ce-1265-4a0d-8cfd-1896ba6c084e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678661', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062947', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:43:15,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`57ebf7ce-1265-4a0d-8cfd-1896ba6c084e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:43:15,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:43:15,329::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:43:15,330::task::993::Storage.TaskManager.Task::(_decref) Task=`57ebf7ce-1265-4a0d-8cfd-1896ba6c084e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:43:17,584::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:43:17,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000546676 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:43:17,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:43:17,718::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00057895 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:43:27,595::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:43:27,603::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700684 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:43:27,720::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:43:27,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648824 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:43:30,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd7e654c-c274-4cae-aa57-9b92c75ef633`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:43:30,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:43:30,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648824', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700684', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:43:30,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd7e654c-c274-4cae-aa57-9b92c75ef633`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648824', 'lastCheck': '2.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700684', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:43:30,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd7e654c-c274-4cae-aa57-9b92c75ef633`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:43:30,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:43:30,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:43:30,435::task::993::Storage.TaskManager.Task::(_decref) Task=`bd7e654c-c274-4cae-aa57-9b92c75ef633`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:43:37,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:43:37,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647207 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:43:37,730::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:43:37,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655821 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:43:45,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`2eac39cf-9b8e-48e7-ac05-57a56bc8fb66`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:43:45,537::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:43:45,537::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655821', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647207', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:43:45,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`2eac39cf-9b8e-48e7-ac05-57a56bc8fb66`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655821', 'lastCheck': '7.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647207', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:43:45,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`2eac39cf-9b8e-48e7-ac05-57a56bc8fb66`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:43:45,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:43:45,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:43:45,538::task::993::Storage.TaskManager.Task::(_decref) Task=`2eac39cf-9b8e-48e7-ac05-57a56bc8fb66`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:43:47,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:43:47,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552495 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:43:47,739::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:43:47,747::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651036 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:43:57,641::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:43:57,649::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693458 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:43:57,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:43:57,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617827 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:44:00,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`c47e7ba4-e344-438e-a36a-e9e1cda562cc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:44:00,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:44:00,655::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617827', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693458', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:44:00,656::task::1191::Storage.TaskManager.Task::(prepare) Task=`c47e7ba4-e344-438e-a36a-e9e1cda562cc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617827', 'lastCheck': '2.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693458', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:44:00,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`c47e7ba4-e344-438e-a36a-e9e1cda562cc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:44:00,656::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:44:00,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:44:00,656::task::993::Storage.TaskManager.Task::(_decref) Task=`c47e7ba4-e344-438e-a36a-e9e1cda562cc`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:44:07,652::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:44:07,653::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:44:07,660::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:44:07,668::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000623201 s, 3.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:44:07,668::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000623201 s, 3.3 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:44:07,668::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:44:07,668::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:44:07,668::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:44:07,669::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:44:07,669::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:44:07,669::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:44:07,669::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:44:07,670::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:44:07,670::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:07,758::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:44:07,759::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:44:07,760::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:07,769::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000868474 s, 2.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:07,769::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000868474 s, 2.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:44:07,769::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:44:07,769::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:44:07,770::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:44:07,770::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 18:44:07,926::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:44:07,927::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:44:07,928::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-16::DEBUG::2014-08-12 18:44:07,928::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:44:07,931::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::INFO::2014-08-12 18:44:07,932::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:44:07,933::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:44:07,934::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:44:07,934::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:44:07,936::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:07,936::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:44:07,945::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:44:07,945::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:44:08,105::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:44:08,105::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:44:08,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000485314 s, 8.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:08,127::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:08,127::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:44:08,127::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:44:08,128::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:44:08,129::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:44:08,129::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:44:08,129::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:08,296::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:08,296::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:08,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000549446 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:44:15,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e63b3f1-697d-474c-83c5-4952dd9ac124`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:44:15,822::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:44:15,822::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549446', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485314', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:44:15,822::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e63b3f1-697d-474c-83c5-4952dd9ac124`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000549446', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485314', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:44:15,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e63b3f1-697d-474c-83c5-4952dd9ac124`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:44:15,823::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:44:15,823::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:44:15,823::task::993::Storage.TaskManager.Task::(_decref) Task=`3e63b3f1-697d-474c-83c5-4952dd9ac124`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:44:18,117::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:44:18,126::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061945 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:18,307::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:18,315::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688849 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:44:28,129::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:44:28,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712188 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:28,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:28,325::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059252 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:44:30,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`9563149a-c23c-409a-8ee1-0c8609a88842`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:44:30,926::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:44:30,927::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059252', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712188', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:44:30,927::task::1191::Storage.TaskManager.Task::(prepare) Task=`9563149a-c23c-409a-8ee1-0c8609a88842`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059252', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712188', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:44:30,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`9563149a-c23c-409a-8ee1-0c8609a88842`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:44:30,927::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:44:30,927::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:44:30,927::task::993::Storage.TaskManager.Task::(_decref) Task=`9563149a-c23c-409a-8ee1-0c8609a88842`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:44:38,140::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:44:38,148::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000812773 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:38,327::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:38,334::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611999 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:44:46,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`feabd47a-8c64-43d7-9cb7-dadb07e9f9e8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:44:46,035::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:44:46,035::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611999', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000812773', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:44:46,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`feabd47a-8c64-43d7-9cb7-dadb07e9f9e8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611999', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000812773', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:44:46,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`feabd47a-8c64-43d7-9cb7-dadb07e9f9e8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:44:46,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:44:46,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:44:46,036::task::993::Storage.TaskManager.Task::(_decref) Task=`feabd47a-8c64-43d7-9cb7-dadb07e9f9e8`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:44:48,152::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:44:48,160::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612534 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:48,335::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:48,343::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608885 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:44:58,164::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:44:58,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655853 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:44:58,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:44:58,354::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598609 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:45:01,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc0dd6c5-a7e4-4d22-acd8-a7e3fddbc754`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:45:01,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:45:01,145::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598609', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655853', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:45:01,145::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc0dd6c5-a7e4-4d22-acd8-a7e3fddbc754`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598609', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655853', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:45:01,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc0dd6c5-a7e4-4d22-acd8-a7e3fddbc754`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:45:01,145::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:45:01,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:45:01,145::task::993::Storage.TaskManager.Task::(_decref) Task=`dc0dd6c5-a7e4-4d22-acd8-a7e3fddbc754`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:45:08,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:45:08,182::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703871 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:45:08,355::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:45:08,363::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000767666 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:45:16,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`eef61191-da9c-4567-8c23-4c93a6d6250d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:45:16,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:45:16,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000767666', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703871', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:45:16,265::task::1191::Storage.TaskManager.Task::(prepare) Task=`eef61191-da9c-4567-8c23-4c93a6d6250d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000767666', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703871', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:45:16,266::task::595::Storage.TaskManager.Task::(_updateState) Task=`eef61191-da9c-4567-8c23-4c93a6d6250d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:45:16,266::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:45:16,266::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:45:16,266::task::993::Storage.TaskManager.Task::(_decref) Task=`eef61191-da9c-4567-8c23-4c93a6d6250d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:45:18,186::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:45:18,195::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677349 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:45:18,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:45:18,371::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657593 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:45:28,198::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:45:28,206::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677788 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:45:28,373::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:45:28,381::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631478 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:45:31,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`d741aee4-404e-44aa-9766-e9ca65afd93b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:45:31,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:45:31,374::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631478', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677788', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:45:31,375::task::1191::Storage.TaskManager.Task::(prepare) Task=`d741aee4-404e-44aa-9766-e9ca65afd93b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631478', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677788', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:45:31,375::task::595::Storage.TaskManager.Task::(_updateState) Task=`d741aee4-404e-44aa-9766-e9ca65afd93b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:45:31,375::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:45:31,375::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:45:31,375::task::993::Storage.TaskManager.Task::(_decref) Task=`d741aee4-404e-44aa-9766-e9ca65afd93b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:45:38,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:45:38,217::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682422 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:45:38,383::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:45:38,390::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648364 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:45:46,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`23b29a36-30d1-4648-9d3f-7940ac994208`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:45:46,508::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:45:46,509::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648364', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682422', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:45:46,509::task::1191::Storage.TaskManager.Task::(prepare) Task=`23b29a36-30d1-4648-9d3f-7940ac994208`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648364', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682422', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:45:46,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`23b29a36-30d1-4648-9d3f-7940ac994208`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:45:46,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:45:46,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:45:46,509::task::993::Storage.TaskManager.Task::(_decref) Task=`23b29a36-30d1-4648-9d3f-7940ac994208`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:45:48,221::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:45:48,229::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627447 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:45:48,391::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:45:48,400::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754855 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:45:58,232::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:45:58,240::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760881 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:45:58,401::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:45:58,410::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652714 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:46:01,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`63399f29-a14c-4114-ad14-bf138d4c9a52`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:46:01,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:46:01,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652714', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760881', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:46:01,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`63399f29-a14c-4114-ad14-bf138d4c9a52`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652714', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760881', 'lastCheck': '3.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:46:01,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`63399f29-a14c-4114-ad14-bf138d4c9a52`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:46:01,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:46:01,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:46:01,627::task::993::Storage.TaskManager.Task::(_decref) Task=`63399f29-a14c-4114-ad14-bf138d4c9a52`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:46:08,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:46:08,251::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639709 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:46:08,411::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:46:08,418::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612729 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:46:16,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`a151974f-ca8f-4171-8f6f-c84df4e61923`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:46:16,743::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:46:16,743::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612729', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639709', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:46:16,743::task::1191::Storage.TaskManager.Task::(prepare) Task=`a151974f-ca8f-4171-8f6f-c84df4e61923`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612729', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639709', 'lastCheck': '8.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:46:16,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`a151974f-ca8f-4171-8f6f-c84df4e61923`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:46:16,744::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:46:16,744::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:46:16,744::task::993::Storage.TaskManager.Task::(_decref) Task=`a151974f-ca8f-4171-8f6f-c84df4e61923`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:46:18,254::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:46:18,262::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571863 s, 7.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:46:18,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:46:18,428::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000791013 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:46:28,266::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:46:28,275::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781015 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:46:28,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:46:28,438::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065071 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:46:31,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2456e99-8095-4d18-a82a-eecdeb32d2b1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:46:31,857::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:46:31,857::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065071', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781015', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:46:31,857::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2456e99-8095-4d18-a82a-eecdeb32d2b1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065071', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781015', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:46:31,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2456e99-8095-4d18-a82a-eecdeb32d2b1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:46:31,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:46:31,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:46:31,858::task::993::Storage.TaskManager.Task::(_decref) Task=`b2456e99-8095-4d18-a82a-eecdeb32d2b1`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:46:38,278::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:46:38,286::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665493 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:46:38,440::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:46:38,448::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710328 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:46:46,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcd4d29e-99a4-4e73-9355-230d96309dd5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:46:46,965::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:46:46,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710328', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665493', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:46:46,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcd4d29e-99a4-4e73-9355-230d96309dd5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000710328', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665493', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:46:46,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcd4d29e-99a4-4e73-9355-230d96309dd5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:46:46,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:46:46,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:46:46,966::task::993::Storage.TaskManager.Task::(_decref) Task=`bcd4d29e-99a4-4e73-9355-230d96309dd5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:46:48,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:46:48,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612597 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:46:48,449::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:46:48,457::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701207 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:46:58,308::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:46:58,452::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.135706 s, 30.2 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:46:58,459::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:46:58,468::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00116008 s, 3.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:47:02,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4a6061b-cd08-43b8-a1da-b4ffe3f8ea50`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:47:02,072::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:47:02,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116008', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.135706', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:47:02,073::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4a6061b-cd08-43b8-a1da-b4ffe3f8ea50`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116008', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.135706', 'lastCheck': '3.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:47:02,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4a6061b-cd08-43b8-a1da-b4ffe3f8ea50`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:47:02,073::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:47:02,073::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:47:02,073::task::993::Storage.TaskManager.Task::(_decref) Task=`b4a6061b-cd08-43b8-a1da-b4ffe3f8ea50`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:47:08,455::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:47:08,463::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067205 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:47:08,469::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:47:08,479::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585423 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:47:17,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d2aa99c-b506-40fc-98d9-d31902a9453c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:47:17,189::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:47:17,189::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585423', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067205', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:47:17,190::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d2aa99c-b506-40fc-98d9-d31902a9453c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585423', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067205', 'lastCheck': '8.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:47:17,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d2aa99c-b506-40fc-98d9-d31902a9453c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:47:17,190::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:47:17,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:47:17,190::task::993::Storage.TaskManager.Task::(_decref) Task=`2d2aa99c-b506-40fc-98d9-d31902a9453c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:47:18,484::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:47:18,495::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:47:18,496::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062419 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:47:18,504::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666083 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:47:28,506::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:47:28,517::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664659 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:47:28,517::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:47:28,527::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648362 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:47:32,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`edae24f5-2237-484d-bead-4f64c599e39c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:47:32,292::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:47:32,293::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664659', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648362', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:47:32,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`edae24f5-2237-484d-bead-4f64c599e39c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664659', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648362', 'lastCheck': '3.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:47:32,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`edae24f5-2237-484d-bead-4f64c599e39c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:47:32,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:47:32,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:47:32,294::task::993::Storage.TaskManager.Task::(_decref) Task=`edae24f5-2237-484d-bead-4f64c599e39c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:47:38,528::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:47:38,536::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:47:38,545::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000681855 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:47:38,547::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064832 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:47:47,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a6b49c3-6913-4faf-bbae-3b3231c6327a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:47:47,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:47:47,419::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681855', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064832', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:47:47,420::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a6b49c3-6913-4faf-bbae-3b3231c6327a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000681855', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064832', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:47:47,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a6b49c3-6913-4faf-bbae-3b3231c6327a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:47:47,420::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:47:47,420::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:47:47,420::task::993::Storage.TaskManager.Task::(_decref) Task=`9a6b49c3-6913-4faf-bbae-3b3231c6327a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:47:48,549::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:47:48,558::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065681 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:47:48,559::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:47:48,566::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658148 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:47:58,560::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:47:58,568::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711123 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:47:58,569::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:47:58,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664442 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:48:02,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`12c239db-9fe9-4d14-910f-d50b80dcfc09`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:48:02,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:48:02,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711123', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664442', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:48:02,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`12c239db-9fe9-4d14-910f-d50b80dcfc09`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711123', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664442', 'lastCheck': '4.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:48:02,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`12c239db-9fe9-4d14-910f-d50b80dcfc09`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:48:02,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:48:02,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:48:02,546::task::993::Storage.TaskManager.Task::(_decref) Task=`12c239db-9fe9-4d14-910f-d50b80dcfc09`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:48:08,569::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:48:08,580::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631181 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:48:08,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:48:08,589::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674711 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:48:17,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`abb9e1d3-5c7d-4e2b-a765-8f3252c4c0d3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:48:17,658::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:48:17,658::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631181', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674711', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:48:17,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`abb9e1d3-5c7d-4e2b-a765-8f3252c4c0d3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631181', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674711', 'lastCheck': '9.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:48:17,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`abb9e1d3-5c7d-4e2b-a765-8f3252c4c0d3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:48:17,658::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:48:17,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:48:17,659::task::993::Storage.TaskManager.Task::(_decref) Task=`abb9e1d3-5c7d-4e2b-a765-8f3252c4c0d3`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:48:18,582::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:48:18,591::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548463 s, 7.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:48:18,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:48:18,600::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063945 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:48:28,592::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:48:28,600::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656403 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:48:28,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:48:28,612::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605415 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:48:32,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`27c97345-c79a-4ba5-a077-2644200b8806`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:48:32,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:48:32,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656403', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605415', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:48:32,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`27c97345-c79a-4ba5-a077-2644200b8806`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656403', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605415', 'lastCheck': '4.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:48:32,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`27c97345-c79a-4ba5-a077-2644200b8806`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:48:32,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:48:32,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:48:32,788::task::993::Storage.TaskManager.Task::(_decref) Task=`27c97345-c79a-4ba5-a077-2644200b8806`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:48:38,602::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:48:38,609::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633096 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:48:38,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:48:38,623::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070093 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:48:47,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d967bc8-086f-4c39-9830-9ea3a954034c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:48:47,901::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:48:47,902::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633096', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070093', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:48:47,902::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d967bc8-086f-4c39-9830-9ea3a954034c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633096', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070093', 'lastCheck': '9.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:48:47,902::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d967bc8-086f-4c39-9830-9ea3a954034c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:48:47,902::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:48:47,902::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:48:47,903::task::993::Storage.TaskManager.Task::(_decref) Task=`2d967bc8-086f-4c39-9830-9ea3a954034c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:48:48,611::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:48:48,620::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612664 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:48:48,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:48:48,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645624 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:48:58,621::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:48:58,629::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694878 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:48:58,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:48:58,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060538 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:49:03,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`83e650a4-5e4e-4e82-a3ad-4258325d01d7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:49:03,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:49:03,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694878', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060538', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:49:03,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`83e650a4-5e4e-4e82-a3ad-4258325d01d7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694878', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060538', 'lastCheck': '4.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:49:03,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`83e650a4-5e4e-4e82-a3ad-4258325d01d7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:49:03,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:49:03,013::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:49:03,013::task::993::Storage.TaskManager.Task::(_decref) Task=`83e650a4-5e4e-4e82-a3ad-4258325d01d7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:49:08,631::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:49:08,631::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:49:08,631::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:49:08,639::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000607605 s, 3.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:49:08,640::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000607605 s, 3.4 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:49:08,640::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:49:08,640::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:49:08,640::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:49:08,640::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:49:08,641::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:49:08,641::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:49:08,641::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:49:08,641::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:49:08,642::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:08,649::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:49:08,650::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:49:08,650::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:08,658::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000611312 s, 3.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:08,659::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000611312 s, 3.4 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:49:08,659::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:49:08,659::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:49:08,659::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:49:08,660::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 18:49:08,887::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:49:08,887::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:49:08,888::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 18:49:08,889::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:49:08,891::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 18:49:08,892::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:49:08,893::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-17::DEBUG::2014-08-12 18:49:08,894::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::INFO::2014-08-12 18:49:08,894::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 18:49:08,896::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:49:08,896::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:08,905::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:49:08,906::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:49:09,064::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:49:09,064::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:49:09,073::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594752 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:09,085::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:09,086::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:49:09,086::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 18:49:09,087::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:49:09,087::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:49:09,087::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 18:49:09,088::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:09,255::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:09,255::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:09,265::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582103 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:49:18,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6880bd5-0b5e-45ef-820e-d93c37bf8bce`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:49:18,123::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:49:18,123::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594752', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582103', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:49:18,123::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6880bd5-0b5e-45ef-820e-d93c37bf8bce`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594752', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582103', 'lastCheck': '8.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:49:18,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6880bd5-0b5e-45ef-820e-d93c37bf8bce`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:49:18,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:49:18,124::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:49:18,124::task::993::Storage.TaskManager.Task::(_decref) Task=`b6880bd5-0b5e-45ef-820e-d93c37bf8bce`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:49:19,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:49:19,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587576 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:19,269::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:19,277::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610718 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:49:29,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:49:29,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779966 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:29,280::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:29,288::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616881 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:49:33,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf8239db-1169-452a-84f8-fdb6c02cd207`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:49:33,233::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:49:33,233::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779966', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616881', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:49:33,233::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf8239db-1169-452a-84f8-fdb6c02cd207`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779966', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616881', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:49:33,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf8239db-1169-452a-84f8-fdb6c02cd207`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:49:33,234::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:49:33,234::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:49:33,234::task::993::Storage.TaskManager.Task::(_decref) Task=`cf8239db-1169-452a-84f8-fdb6c02cd207`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:49:39,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:49:39,103::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696021 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:39,300::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:39,308::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058801 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:49:48,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`88fc0e54-369a-4a23-8d0b-046837c779ae`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:49:48,350::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:49:48,350::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696021', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058801', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:49:48,350::task::1191::Storage.TaskManager.Task::(prepare) Task=`88fc0e54-369a-4a23-8d0b-046837c779ae`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696021', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058801', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:49:48,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`88fc0e54-369a-4a23-8d0b-046837c779ae`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:49:48,351::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:49:48,351::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:49:48,351::task::993::Storage.TaskManager.Task::(_decref) Task=`88fc0e54-369a-4a23-8d0b-046837c779ae`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:49:49,105::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:49:49,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668813 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:49,312::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:49,320::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694884 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:49:59,115::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:49:59,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712509 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:49:59,323::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:49:59,331::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600463 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:50:03,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb51e392-c030-44bb-8689-7284941b59a8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:50:03,465::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:50:03,466::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712509', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600463', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:50:03,466::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb51e392-c030-44bb-8689-7284941b59a8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712509', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600463', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:50:03,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb51e392-c030-44bb-8689-7284941b59a8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:50:03,466::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:50:03,466::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:50:03,466::task::993::Storage.TaskManager.Task::(_decref) Task=`fb51e392-c030-44bb-8689-7284941b59a8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:50:09,126::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:50:09,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732654 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:50:09,334::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:50:09,342::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060817 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:50:18,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa56cb1a-cd4a-4c37-9a03-c6217c762c31`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:50:18,573::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:50:18,573::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732654', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060817', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:50:18,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa56cb1a-cd4a-4c37-9a03-c6217c762c31`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732654', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060817', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:50:18,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa56cb1a-cd4a-4c37-9a03-c6217c762c31`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:50:18,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:50:18,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:50:18,574::task::993::Storage.TaskManager.Task::(_decref) Task=`fa56cb1a-cd4a-4c37-9a03-c6217c762c31`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:50:19,137::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:50:19,145::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697514 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:50:19,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:50:19,354::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637508 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:50:29,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:50:29,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707498 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:50:29,357::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:50:29,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599522 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:50:33,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed5648e9-cbd9-453b-b980-d72bb2014bbf`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:50:33,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:50:33,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707498', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599522', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:50:33,676::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed5648e9-cbd9-453b-b980-d72bb2014bbf`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707498', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599522', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:50:33,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed5648e9-cbd9-453b-b980-d72bb2014bbf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:50:33,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:50:33,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:50:33,676::task::993::Storage.TaskManager.Task::(_decref) Task=`ed5648e9-cbd9-453b-b980-d72bb2014bbf`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:50:39,156::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:50:39,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765474 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:50:39,369::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:50:39,376::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683299 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:50:48,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfb02707-7f1f-409f-9f7c-2f207103d854`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:50:48,783::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:50:48,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765474', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683299', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:50:48,784::task::1191::Storage.TaskManager.Task::(prepare) Task=`cfb02707-7f1f-409f-9f7c-2f207103d854`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765474', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683299', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:50:48,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfb02707-7f1f-409f-9f7c-2f207103d854`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:50:48,784::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:50:48,784::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:50:48,785::task::993::Storage.TaskManager.Task::(_decref) Task=`cfb02707-7f1f-409f-9f7c-2f207103d854`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:50:49,167::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:50:49,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614898 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:50:49,379::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:50:49,388::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574149 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:50:59,176::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:50:59,185::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644614 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:50:59,391::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:50:59,399::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611284 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:51:03,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`b02a6d3a-54b4-44db-ac6f-be904c5cc204`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:51:03,894::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:51:03,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644614', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611284', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:51:03,894::task::1191::Storage.TaskManager.Task::(prepare) Task=`b02a6d3a-54b4-44db-ac6f-be904c5cc204`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644614', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611284', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:51:03,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`b02a6d3a-54b4-44db-ac6f-be904c5cc204`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:51:03,894::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:51:03,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:51:03,895::task::993::Storage.TaskManager.Task::(_decref) Task=`b02a6d3a-54b4-44db-ac6f-be904c5cc204`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:51:09,201::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:51:09,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640656 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:51:09,402::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:51:09,411::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612209 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:51:19,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`c437fa90-0158-4ef6-be10-4c2d633bbaf6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:51:19,026::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:51:19,026::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640656', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612209', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:51:19,026::task::1191::Storage.TaskManager.Task::(prepare) Task=`c437fa90-0158-4ef6-be10-4c2d633bbaf6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640656', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612209', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:51:19,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`c437fa90-0158-4ef6-be10-4c2d633bbaf6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:51:19,027::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:51:19,027::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:51:19,027::task::993::Storage.TaskManager.Task::(_decref) Task=`c437fa90-0158-4ef6-be10-4c2d633bbaf6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:51:19,213::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:51:19,221::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700853 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:51:19,414::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:51:19,422::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000586917 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:51:29,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:51:29,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704361 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:51:29,426::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:51:29,434::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633058 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:51:34,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`d75b6316-ea19-408f-80ca-749948312f9f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:51:34,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:51:34,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704361', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633058', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:51:34,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`d75b6316-ea19-408f-80ca-749948312f9f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704361', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633058', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:51:34,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`d75b6316-ea19-408f-80ca-749948312f9f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:51:34,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:51:34,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:51:34,135::task::993::Storage.TaskManager.Task::(_decref) Task=`d75b6316-ea19-408f-80ca-749948312f9f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:51:39,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:51:39,241::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716838 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:51:39,437::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:51:39,445::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663611 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:51:49,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:51:49,252::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598481 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:51:49,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a21365a-f09d-4deb-b178-447eb23fd685`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:51:49,256::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:51:49,256::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598481', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663611', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:51:49,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a21365a-f09d-4deb-b178-447eb23fd685`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598481', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663611', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:51:49,256::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a21365a-f09d-4deb-b178-447eb23fd685`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:51:49,257::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:51:49,257::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:51:49,257::task::993::Storage.TaskManager.Task::(_decref) Task=`5a21365a-f09d-4deb-b178-447eb23fd685`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 18:51:49,447::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:51:49,456::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729789 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:51:59,255::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:51:59,264::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007297 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:51:59,460::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:51:59,469::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671274 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:52:04,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`89330f99-b84a-400d-aa2f-807f9df6abee`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:52:04,370::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:52:04,370::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007297', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671274', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:52:04,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`89330f99-b84a-400d-aa2f-807f9df6abee`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0007297', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671274', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:52:04,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`89330f99-b84a-400d-aa2f-807f9df6abee`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:52:04,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:52:04,371::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:52:04,371::task::993::Storage.TaskManager.Task::(_decref) Task=`89330f99-b84a-400d-aa2f-807f9df6abee`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:52:09,265::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:52:09,273::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669382 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:52:09,479::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:52:09,487::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000824732 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:52:19,275::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:52:19,283::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614048 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:52:19,491::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:52:19,502::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670452 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:52:19,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`7293cdf7-cd87-4aa0-a82f-32ad0e93d7b5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:52:19,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:52:19,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614048', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000824732', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:52:19,516::task::1191::Storage.TaskManager.Task::(prepare) Task=`7293cdf7-cd87-4aa0-a82f-32ad0e93d7b5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614048', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000824732', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:52:19,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`7293cdf7-cd87-4aa0-a82f-32ad0e93d7b5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:52:19,517::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:52:19,517::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:52:19,518::task::993::Storage.TaskManager.Task::(_decref) Task=`7293cdf7-cd87-4aa0-a82f-32ad0e93d7b5`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:52:29,285::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:52:29,294::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725161 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:52:29,518::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:52:29,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661688 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:52:34,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`106b1730-1c7f-4a64-80e4-9a641d447b8a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:52:34,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:52:34,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725161', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661688', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:52:34,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`106b1730-1c7f-4a64-80e4-9a641d447b8a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725161', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661688', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:52:34,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`106b1730-1c7f-4a64-80e4-9a641d447b8a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:52:34,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:52:34,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:52:34,627::task::993::Storage.TaskManager.Task::(_decref) Task=`106b1730-1c7f-4a64-80e4-9a641d447b8a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:52:39,295::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:52:39,304::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000691168 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:52:39,529::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:52:39,538::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648897 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:52:49,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:52:49,314::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652279 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:52:49,541::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:52:49,550::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595751 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:52:49,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`79312d93-ca85-4f67-8d2c-c538d91f8577`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:52:49,730::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:52:49,730::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652279', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595751', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:52:49,731::task::1191::Storage.TaskManager.Task::(prepare) Task=`79312d93-ca85-4f67-8d2c-c538d91f8577`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652279', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595751', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:52:49,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`79312d93-ca85-4f67-8d2c-c538d91f8577`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:52:49,731::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:52:49,731::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:52:49,731::task::993::Storage.TaskManager.Task::(_decref) Task=`79312d93-ca85-4f67-8d2c-c538d91f8577`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:52:59,316::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:52:59,324::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674047 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:52:59,553::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:52:59,562::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562505 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:53:04,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b64160b-160d-4a32-aeb6-32e66bd6d4f3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:53:04,840::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:53:04,840::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674047', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562505', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:53:04,840::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b64160b-160d-4a32-aeb6-32e66bd6d4f3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674047', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562505', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:53:04,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b64160b-160d-4a32-aeb6-32e66bd6d4f3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:53:04,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:53:04,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:53:04,841::task::993::Storage.TaskManager.Task::(_decref) Task=`1b64160b-160d-4a32-aeb6-32e66bd6d4f3`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:53:09,325::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:53:09,334::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766353 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:53:09,565::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:53:09,572::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697503 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:53:19,335::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:53:19,343::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607595 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:53:19,575::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:53:19,584::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063961 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:53:19,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`02555da6-b8fb-4646-a347-b16ee345ef9e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:53:19,955::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:53:19,956::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607595', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063961', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:53:19,956::task::1191::Storage.TaskManager.Task::(prepare) Task=`02555da6-b8fb-4646-a347-b16ee345ef9e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607595', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063961', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:53:19,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`02555da6-b8fb-4646-a347-b16ee345ef9e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:53:19,956::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:53:19,956::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:53:19,956::task::993::Storage.TaskManager.Task::(_decref) Task=`02555da6-b8fb-4646-a347-b16ee345ef9e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:53:29,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:53:29,354::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725521 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:53:29,588::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:53:29,596::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665705 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:53:35,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`593ebf49-003a-4638-8e44-06008694aa8c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:53:35,066::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:53:35,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725521', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665705', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:53:35,066::task::1191::Storage.TaskManager.Task::(prepare) Task=`593ebf49-003a-4638-8e44-06008694aa8c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725521', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665705', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:53:35,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`593ebf49-003a-4638-8e44-06008694aa8c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:53:35,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:53:35,067::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:53:35,067::task::993::Storage.TaskManager.Task::(_decref) Task=`593ebf49-003a-4638-8e44-06008694aa8c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:53:39,355::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:53:39,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069413 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:53:39,599::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:53:39,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688559 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:53:49,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:53:49,374::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709825 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:53:49,610::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:53:49,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676212 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:53:50,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b6576ea-9ae3-4525-8e97-1151b1bdf273`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:53:50,186::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:53:50,186::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709825', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676212', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:53:50,186::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b6576ea-9ae3-4525-8e97-1151b1bdf273`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709825', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676212', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:53:50,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b6576ea-9ae3-4525-8e97-1151b1bdf273`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:53:50,186::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:53:50,187::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:53:50,187::task::993::Storage.TaskManager.Task::(_decref) Task=`3b6576ea-9ae3-4525-8e97-1151b1bdf273`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:53:59,376::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:53:59,384::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000852599 s, 4.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:53:59,621::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:53:59,630::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799151 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:54:05,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b418f8e-b908-4238-ad11-2a8fa4c82df8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:54:05,356::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:54:05,357::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000852599', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799151', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:54:05,357::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b418f8e-b908-4238-ad11-2a8fa4c82df8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000852599', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799151', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:54:05,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b418f8e-b908-4238-ad11-2a8fa4c82df8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:54:05,357::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:54:05,357::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:54:05,357::task::993::Storage.TaskManager.Task::(_decref) Task=`2b418f8e-b908-4238-ad11-2a8fa4c82df8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:54:09,385::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:54:09,386::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:54:09,386::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:54:09,394::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000623053 s, 3.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:54:09,394::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000623053 s, 3.3 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:54:09,394::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:54:09,395::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:54:09,395::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:54:09,395::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:54:09,395::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:54:09,396::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:54:09,396::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:54:09,396::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:54:09,396::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:09,633::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:54:09,634::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:54:09,634::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:09,642::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000553262 s, 3.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:54:09,643::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000553262 s, 3.7 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:54:09,643::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:54:09,643::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:54:09,643::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:54:09,644::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 18:54:09,666::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:54:09,666::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:54:09,667::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 18:54:09,667::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:54:09,669::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:54:09,670::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::INFO::2014-08-12 18:54:09,671::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:54:09,671::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-17::DEBUG::2014-08-12 18:54:09,672::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 18:54:09,672::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:54:09,673::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:09,673::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:54:09,681::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:54:09,882::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:54:09,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:54:09,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000838186 s, 4.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:54:09,910::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:54:09,911::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:54:09,911::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 18:54:09,912::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:54:09,912::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:54:09,912::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 18:54:09,913::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:10,078::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:54:10,079::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:10,087::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606572 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:54:19,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:54:19,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613703 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:54:20,090::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:20,098::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657745 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:54:20,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d24a3d5-07d4-40ed-9331-78d97d9b363b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:54:20,475::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:54:20,483::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613703', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657745', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:54:20,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d24a3d5-07d4-40ed-9331-78d97d9b363b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613703', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657745', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:54:20,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d24a3d5-07d4-40ed-9331-78d97d9b363b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:54:20,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:54:20,484::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:54:20,484::task::993::Storage.TaskManager.Task::(_decref) Task=`7d24a3d5-07d4-40ed-9331-78d97d9b363b`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:54:29,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:54:29,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731678 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:54:30,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:30,110::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667166 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:54:35,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`476c1325-ebbd-4262-bad4-e5f83da4feef`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:54:35,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:54:35,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731678', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667166', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:54:35,590::task::1191::Storage.TaskManager.Task::(prepare) Task=`476c1325-ebbd-4262-bad4-e5f83da4feef`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731678', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667166', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:54:35,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`476c1325-ebbd-4262-bad4-e5f83da4feef`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:54:35,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:54:35,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:54:35,590::task::993::Storage.TaskManager.Task::(_decref) Task=`476c1325-ebbd-4262-bad4-e5f83da4feef`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:54:39,912::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:54:39,921::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634853 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:54:40,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:40,120::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000542731 s, 7.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:54:49,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:54:49,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620751 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:54:50,123::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:54:50,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000565764 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:54:50,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b1a9d11-6d10-41ae-849b-1bd91fa7a6f5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:54:50,695::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:54:50,696::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620751', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565764', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:54:50,696::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b1a9d11-6d10-41ae-849b-1bd91fa7a6f5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620751', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565764', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:54:50,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b1a9d11-6d10-41ae-849b-1bd91fa7a6f5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:54:50,696::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:54:50,696::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:54:50,697::task::993::Storage.TaskManager.Task::(_decref) Task=`8b1a9d11-6d10-41ae-849b-1bd91fa7a6f5`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:54:59,933::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:54:59,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759791 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:55:00,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:55:00,144::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674745 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:55:05,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`83fc491a-f352-491c-950c-5544fb88d3b1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:55:05,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:55:05,810::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759791', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674745', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:55:05,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`83fc491a-f352-491c-950c-5544fb88d3b1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759791', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674745', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:55:05,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`83fc491a-f352-491c-950c-5544fb88d3b1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:55:05,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:55:05,810::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:55:05,810::task::993::Storage.TaskManager.Task::(_decref) Task=`83fc491a-f352-491c-950c-5544fb88d3b1`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:55:09,943::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:55:09,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575191 s, 7.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:55:10,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:55:10,337::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.183219 s, 22.4 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:55:19,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:55:19,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622328 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:55:20,340::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:55:20,348::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666701 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:55:20,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`154adae0-49ff-4be0-bc02-86d1ed9b9bfd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:55:20,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:55:20,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622328', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666701', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:55:20,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`154adae0-49ff-4be0-bc02-86d1ed9b9bfd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622328', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666701', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:55:20,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`154adae0-49ff-4be0-bc02-86d1ed9b9bfd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:55:20,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:55:20,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:55:20,929::task::993::Storage.TaskManager.Task::(_decref) Task=`154adae0-49ff-4be0-bc02-86d1ed9b9bfd`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:55:29,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:55:29,972::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696302 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:55:30,351::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:55:30,359::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700811 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:55:36,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`4905eb0c-27b6-4a35-95fc-ba4c66b59092`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:55:36,039::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:55:36,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696302', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700811', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:55:36,040::task::1191::Storage.TaskManager.Task::(prepare) Task=`4905eb0c-27b6-4a35-95fc-ba4c66b59092`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696302', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700811', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:55:36,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`4905eb0c-27b6-4a35-95fc-ba4c66b59092`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:55:36,040::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:55:36,040::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:55:36,040::task::993::Storage.TaskManager.Task::(_decref) Task=`4905eb0c-27b6-4a35-95fc-ba4c66b59092`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:55:39,973::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:55:39,982::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074894 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:55:40,363::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:55:40,370::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658047 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:55:49,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:55:49,992::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000560904 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:55:50,373::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:55:50,382::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709245 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:55:51,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`89eebda7-a35a-4f61-baf4-26545ae958b5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:55:51,156::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:55:51,156::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560904', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709245', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:55:51,156::task::1191::Storage.TaskManager.Task::(prepare) Task=`89eebda7-a35a-4f61-baf4-26545ae958b5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560904', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709245', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:55:51,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`89eebda7-a35a-4f61-baf4-26545ae958b5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:55:51,157::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:55:51,157::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:55:51,157::task::993::Storage.TaskManager.Task::(_decref) Task=`89eebda7-a35a-4f61-baf4-26545ae958b5`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:55:59,994::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:56:00,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00077903 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:56:00,385::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:56:00,394::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000917837 s, 4.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:56:06,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`7590bd45-029e-4509-8a83-6eec202a6504`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:56:06,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:56:06,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077903', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000917837', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:56:06,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`7590bd45-029e-4509-8a83-6eec202a6504`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077903', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000917837', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:56:06,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`7590bd45-029e-4509-8a83-6eec202a6504`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:56:06,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:56:06,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:56:06,262::task::993::Storage.TaskManager.Task::(_decref) Task=`7590bd45-029e-4509-8a83-6eec202a6504`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:56:10,003::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:56:10,012::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655487 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:56:10,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:56:10,405::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642975 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:56:20,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:56:20,022::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624847 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:56:20,408::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:56:20,417::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619807 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:56:21,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`d03b9442-21be-4691-a5d1-829ab386a6b3`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:56:21,366::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:56:21,366::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624847', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619807', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:56:21,366::task::1191::Storage.TaskManager.Task::(prepare) Task=`d03b9442-21be-4691-a5d1-829ab386a6b3`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624847', 'lastCheck': '1.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619807', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:56:21,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`d03b9442-21be-4691-a5d1-829ab386a6b3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:56:21,367::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:56:21,367::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:56:21,367::task::993::Storage.TaskManager.Task::(_decref) Task=`d03b9442-21be-4691-a5d1-829ab386a6b3`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:56:30,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:56:30,033::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671536 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:56:30,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:56:30,427::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000676993 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:56:36,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6677338-e920-4c53-92ad-d1af41688624`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:56:36,471::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:56:36,471::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671536', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676993', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:56:36,471::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6677338-e920-4c53-92ad-d1af41688624`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671536', 'lastCheck': '6.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000676993', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:56:36,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6677338-e920-4c53-92ad-d1af41688624`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:56:36,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:56:36,472::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:56:36,472::task::993::Storage.TaskManager.Task::(_decref) Task=`b6677338-e920-4c53-92ad-d1af41688624`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:56:40,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:56:40,043::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729338 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:56:40,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:56:40,438::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000624032 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:56:50,045::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:56:50,052::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686904 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:56:50,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:56:50,450::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058383 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:56:51,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`abb212da-da98-4c6e-91df-b075f18099b7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:56:51,587::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:56:51,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686904', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058383', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:56:51,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`abb212da-da98-4c6e-91df-b075f18099b7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686904', 'lastCheck': '1.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058383', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:56:51,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`abb212da-da98-4c6e-91df-b075f18099b7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:56:51,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:56:51,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:56:51,589::task::993::Storage.TaskManager.Task::(_decref) Task=`abb212da-da98-4c6e-91df-b075f18099b7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:57:00,054::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:57:00,063::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632621 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:57:00,453::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:57:00,460::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672632 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:57:06,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`917148af-7142-44a2-b6bb-768e8c238bf6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:06,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:57:06,712::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632621', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672632', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:57:06,712::task::1191::Storage.TaskManager.Task::(prepare) Task=`917148af-7142-44a2-b6bb-768e8c238bf6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632621', 'lastCheck': '6.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672632', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:57:06,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`917148af-7142-44a2-b6bb-768e8c238bf6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:06,712::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:57:06,712::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:06,713::task::993::Storage.TaskManager.Task::(_decref) Task=`917148af-7142-44a2-b6bb-768e8c238bf6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:57:10,064::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:57:10,073::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692484 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:57:10,463::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:57:10,471::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715391 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:57:20,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:57:20,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062247 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:57:20,474::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:57:20,483::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670775 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:57:21,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`642e691b-45a7-48ae-b32e-332d93010eef`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:21,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:57:21,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062247', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670775', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:57:21,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`642e691b-45a7-48ae-b32e-332d93010eef`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062247', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670775', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:57:21,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`642e691b-45a7-48ae-b32e-332d93010eef`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:21,844::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:57:21,844::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:21,844::task::993::Storage.TaskManager.Task::(_decref) Task=`642e691b-45a7-48ae-b32e-332d93010eef`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:57:30,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:57:30,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613125 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:57:30,486::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:57:30,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692377 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:57:34,277::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4443c904] >Thread-15::DEBUG::2014-08-12 18:57:34,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bd2c537-9a99-4980-920c-9ad8efb6b67f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:34,278::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) >Thread-15::DEBUG::2014-08-12 18:57:34,280::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 18:57:34,281::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=7,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 18:57:34,325::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 18:57:34,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:34,325::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:34,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:34,337::__init__::225::IOProcess::(_processLogs) (300) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:57:34,337::__init__::225::IOProcess::(_processLogs) (300) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:57:34,338::__init__::225::IOProcess::(_processLogs) (300) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:34,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:34,339::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 18:57:34,363::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:57:34,364::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:57:34,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:34,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:34,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:34,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:34,365::__init__::225::IOProcess::(_processLogs) (301) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:57:34,365::__init__::225::IOProcess::(_processLogs) (301) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 18:57:34,365::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-29::DEBUG::2014-08-12 18:57:34,365::__init__::225::IOProcess::(_processLogs) (301) Queuing response >Thread-15::DEBUG::2014-08-12 18:57:34,366::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 18:57:34,367::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-29::DEBUG::2014-08-12 18:57:34,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:57:34,368::task::1191::Storage.TaskManager.Task::(prepare) Task=`2bd2c537-9a99-4980-920c-9ad8efb6b67f`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-29::DEBUG::2014-08-12 18:57:34,368::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 18:57:34,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bd2c537-9a99-4980-920c-9ad8efb6b67f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:34,369::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:57:34,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:34,370::task::993::Storage.TaskManager.Task::(_decref) Task=`2bd2c537-9a99-4980-920c-9ad8efb6b67f`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:57:34,408::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 18:57:34,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`93a9749d-a9d2-4b25-a79a-aefc9467b035`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:34,408::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', options=None) >Thread-15::DEBUG::2014-08-12 18:57:34,409::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:57:34,409::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:57:34,409::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:57:34,409::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:57:34,409::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:57:34,410::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:57:34,438::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:57:34,440::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:57:34,553::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:57:34,554::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:34,554::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:34,554::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:34,554::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:34,555::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:34,555::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:34,555::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:57:34,555::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:34,558::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-15::DEBUG::2014-08-12 18:57:34,850::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:57:34,851::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-29::DEBUG::2014-08-12 18:57:34,853::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:57:34,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:34,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:34,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:34,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:34,854::__init__::225::IOProcess::(_processLogs) (302) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:57:34,854::__init__::225::IOProcess::(_processLogs) (302) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:57:34,856::__init__::225::IOProcess::(_processLogs) (302) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:34,856::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::INFO::2014-08-12 18:57:34,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-15::DEBUG::2014-08-12 18:57:34,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`93a9749d-a9d2-4b25-a79a-aefc9467b035`::finished: {'domlist': []} >Thread-15::DEBUG::2014-08-12 18:57:34,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`93a9749d-a9d2-4b25-a79a-aefc9467b035`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:34,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:57:34,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:34,859::task::993::Storage.TaskManager.Task::(_decref) Task=`93a9749d-a9d2-4b25-a79a-aefc9467b035`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:57:34,951::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5bcc11b7] >Thread-15::DEBUG::2014-08-12 18:57:34,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`459d8f0e-750b-4472-b69f-054172a977eb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:34,952::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}], options=None) >Thread-15::DEBUG::2014-08-12 18:57:34,954::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 18:57:34,955::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:57:34,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:34,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:34,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:34,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:34,956::__init__::225::IOProcess::(_processLogs) (303) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:57:34,956::__init__::225::IOProcess::(_processLogs) (303) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:57:34,956::__init__::225::IOProcess::(_processLogs) (303) Queuing response >Thread-15::DEBUG::2014-08-12 18:57:34,956::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-15::DEBUG::2014-08-12 18:57:34,957::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 18:57:34,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 18:57:34,958::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}]} >Thread-15::DEBUG::2014-08-12 18:57:34,958::task::1191::Storage.TaskManager.Task::(prepare) Task=`459d8f0e-750b-4472-b69f-054172a977eb`::finished: {'statuslist': [{'status': 0, 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}]} >Thread-29::DEBUG::2014-08-12 18:57:34,958::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 18:57:34,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`459d8f0e-750b-4472-b69f-054172a977eb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:34,959::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:57:34,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:34,960::task::993::Storage.TaskManager.Task::(_decref) Task=`459d8f0e-750b-4472-b69f-054172a977eb`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:57:34,979::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5bcc11b7] >Thread-15::DEBUG::2014-08-12 18:57:34,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a20cd40-1ef5-4ac5-bdec-c085a6410765`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:34,980::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='68d897e0-6b30-4609-a78d-cdb2c1411233', domainName='pNFS', typeSpecificArg='netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', domClass=1, domVersion='3', options=None) >Thread-15::DEBUG::2014-08-12 18:57:34,980::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 18:57:34,981::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:57:34,981::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 18:57:34,981::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 18:57:34,981::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 18:57:34,981::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 18:57:35,008::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 18:57:35,010::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 18:57:35,056::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:57:35,057::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:35,057::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:35,057::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:35,058::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:35,058::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:35,058::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:35,058::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::ERROR::2014-08-12 18:57:35,058::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 68d897e0-6b30-4609-a78d-cdb2c1411233 >Thread-15::ERROR::2014-08-12 18:57:35,058::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 68d897e0-6b30-4609-a78d-cdb2c1411233 >Thread-15::DEBUG::2014-08-12 18:57:35,059::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 18:57:35,061::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 68d897e0-6b30-4609-a78d-cdb2c1411233 (cwd None) >Thread-15::DEBUG::2014-08-12 18:57:35,256::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "68d897e0-6b30-4609-a78d-cdb2c1411233" not found\n Skipping volume group 68d897e0-6b30-4609-a78d-cdb2c1411233\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 18:57:35,259::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "68d897e0-6b30-4609-a78d-cdb2c1411233" not found', ' Skipping volume group 68d897e0-6b30-4609-a78d-cdb2c1411233'] >Thread-15::DEBUG::2014-08-12 18:57:35,259::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-29::DEBUG::2014-08-12 18:57:35,262::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 18:57:35,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,262::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,262::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,262::__init__::225::IOProcess::(_processLogs) (304) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:57:35,263::__init__::225::IOProcess::(_processLogs) (304) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:57:35,263::__init__::225::IOProcess::(_processLogs) (304) Queuing response >Thread-15::ERROR::2014-08-12 18:57:35,264::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 68d897e0-6b30-4609-a78d-cdb2c1411233 not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('68d897e0-6b30-4609-a78d-cdb2c1411233',) >Thread-29::DEBUG::2014-08-12 18:57:35,265::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 18:57:35,265::nfsSD::69::Storage.StorageDomain::(create) sdUUID=68d897e0-6b30-4609-a78d-cdb2c1411233 domainName=pNFS remotePath=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 domClass=1 >Thread-29::DEBUG::2014-08-12 18:57:35,266::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:57:35,269::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 18:57:35,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,270::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,271::__init__::225::IOProcess::(_processLogs) (305) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:57:35,271::__init__::225::IOProcess::(_processLogs) (305) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:57:35,271::__init__::225::IOProcess::(_processLogs) (305) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,271::__init__::225::IOProcess::(_processLogs) (305) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,272::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,280::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 18:57:35,280::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,281::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,281::__init__::225::IOProcess::(_processLogs) (306) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 18:57:35,281::__init__::225::IOProcess::(_processLogs) (306) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 18:57:35,282::__init__::225::IOProcess::(_processLogs) (306) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,283::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,283::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-29::DEBUG::2014-08-12 18:57:35,283::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,284::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,284::__init__::225::IOProcess::(_processLogs) (307) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:57:35,284::__init__::225::IOProcess::(_processLogs) (307) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 18:57:35,284::__init__::225::IOProcess::(_processLogs) (307) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,285::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 18:57:35,285::__init__::225::IOProcess::(_processLogs) Message size is 70 >Thread-29::DEBUG::2014-08-12 18:57:35,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,287::__init__::225::IOProcess::(_processLogs) (308) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,287::__init__::225::IOProcess::(_processLogs) (308) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,287::__init__::225::IOProcess::(_processLogs) (308) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,287::__init__::225::IOProcess::(_processLogs) (308) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,287::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,287::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,288::__init__::225::IOProcess::(_processLogs) Message size is 74 >Thread-29::DEBUG::2014-08-12 18:57:35,288::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,289::__init__::225::IOProcess::(_processLogs) (309) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,289::__init__::225::IOProcess::(_processLogs) (309) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,289::__init__::225::IOProcess::(_processLogs) (309) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,289::__init__::225::IOProcess::(_processLogs) (309) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,289::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,290::__init__::225::IOProcess::(_processLogs) Message size is 86 >Thread-29::DEBUG::2014-08-12 18:57:35,290::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,291::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,291::__init__::225::IOProcess::(_processLogs) (310) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,291::__init__::225::IOProcess::(_processLogs) (310) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,292::__init__::225::IOProcess::(_processLogs) (310) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,292::__init__::225::IOProcess::(_processLogs) (310) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,292::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,292::__init__::225::IOProcess::(_processLogs) Message size is 90 >Thread-29::DEBUG::2014-08-12 18:57:35,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,294::__init__::225::IOProcess::(_processLogs) (311) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,294::__init__::225::IOProcess::(_processLogs) (311) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,294::__init__::225::IOProcess::(_processLogs) (311) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,294::__init__::225::IOProcess::(_processLogs) (311) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,294::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,294::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,295::__init__::225::IOProcess::(_processLogs) Message size is 143 >Thread-29::DEBUG::2014-08-12 18:57:35,295::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,296::__init__::225::IOProcess::(_processLogs) (312) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,296::__init__::225::IOProcess::(_processLogs) (312) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,296::__init__::225::IOProcess::(_processLogs) (312) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,297::__init__::225::IOProcess::(_processLogs) (312) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,297::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,297::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 18:57:35,297::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,298::__init__::225::IOProcess::(_processLogs) (313) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,298::__init__::225::IOProcess::(_processLogs) (313) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,299::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,300::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 18:57:35,300::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,301::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,301::__init__::225::IOProcess::(_processLogs) (314) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,301::__init__::225::IOProcess::(_processLogs) (314) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,301::__init__::225::IOProcess::(_processLogs) (314) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,302::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,302::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 18:57:35,303::__init__::225::IOProcess::(_processLogs) Message size is 229 >Thread-29::DEBUG::2014-08-12 18:57:35,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,303::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,304::__init__::225::IOProcess::(_processLogs) (315) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 18:57:35,304::__init__::225::IOProcess::(_processLogs) (315) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 18:57:35,304::__init__::225::IOProcess::(_processLogs) (315) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,305::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,305::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-29::DEBUG::2014-08-12 18:57:35,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,306::__init__::225::IOProcess::(_processLogs) (316) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 18:57:35,306::__init__::225::IOProcess::(_processLogs) (316) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 18:57:35,307::__init__::225::IOProcess::(_processLogs) (316) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,307::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,307::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,307::__init__::225::IOProcess::(_processLogs) Message size is 230 >Thread-29::DEBUG::2014-08-12 18:57:35,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,308::__init__::225::IOProcess::(_processLogs) (317) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 18:57:35,308::__init__::225::IOProcess::(_processLogs) (317) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 18:57:35,309::__init__::225::IOProcess::(_processLogs) (317) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,309::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,309::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 18:57:35,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,310::__init__::225::IOProcess::(_processLogs) (318) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 18:57:35,310::__init__::225::IOProcess::(_processLogs) (318) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 18:57:35,311::__init__::225::IOProcess::(_processLogs) (318) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,311::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,311::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,312::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-29::DEBUG::2014-08-12 18:57:35,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,312::__init__::225::IOProcess::(_processLogs) (319) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 18:57:35,313::__init__::225::IOProcess::(_processLogs) (319) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 18:57:35,313::__init__::225::IOProcess::(_processLogs) (319) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,313::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,314::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 18:57:35,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,314::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,314::__init__::225::IOProcess::(_processLogs) (320) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 18:57:35,315::__init__::225::IOProcess::(_processLogs) (320) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 18:57:35,315::__init__::225::IOProcess::(_processLogs) (320) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,316::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,316::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-29::DEBUG::2014-08-12 18:57:35,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,317::__init__::225::IOProcess::(_processLogs) (321) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 18:57:35,317::__init__::225::IOProcess::(_processLogs) (321) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 18:57:35,317::__init__::225::IOProcess::(_processLogs) (321) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,318::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,318::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,318::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-29::DEBUG::2014-08-12 18:57:35,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,319::__init__::225::IOProcess::(_processLogs) (322) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 18:57:35,319::__init__::225::IOProcess::(_processLogs) (322) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 18:57:35,320::__init__::225::IOProcess::(_processLogs) (322) Queuing response >Thread-15::DEBUG::2014-08-12 18:57:35,321::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 18:57:35,321::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,322::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:57:35,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,323::__init__::225::IOProcess::(_processLogs) (323) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:57:35,323::__init__::225::IOProcess::(_processLogs) (323) Got request for method 'readfile' >Thread-15::DEBUG::2014-08-12 18:57:35,323::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-29::DEBUG::2014-08-12 18:57:35,323::__init__::225::IOProcess::(_processLogs) (323) Queuing response >Thread-15::DEBUG::2014-08-12 18:57:35,324::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 18:57:35,324::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-29::DEBUG::2014-08-12 18:57:35,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:57:35,325::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-29::DEBUG::2014-08-12 18:57:35,325::__init__::225::IOProcess::(_processLogs) Sending response sized 93 >Thread-15::DEBUG::2014-08-12 18:57:35,326::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=68d897e0-6b30-4609-a78d-cdb2c1411233', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=69d0ca1c99d46c3290667030af40f3b4370bbfe0'] >Thread-29::DEBUG::2014-08-12 18:57:35,326::__init__::225::IOProcess::(_processLogs) Message size is 644 >Thread-29::DEBUG::2014-08-12 18:57:35,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,327::__init__::225::IOProcess::(_processLogs) (324) Finding callback 'writefile'... >Thread-29::DEBUG::2014-08-12 18:57:35,327::__init__::225::IOProcess::(_processLogs) (324) Got request for method 'writefile' >Thread-29::DEBUG::2014-08-12 18:57:35,327::__init__::225::IOProcess::(_processLogs) (324) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,328::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::WARNING::2014-08-12 18:57:35,328::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-29::DEBUG::2014-08-12 18:57:35,329::__init__::225::IOProcess::(_processLogs) Message size is 333 >Thread-29::DEBUG::2014-08-12 18:57:35,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,330::__init__::225::IOProcess::(_processLogs) (325) Finding callback 'rename'... >Thread-29::DEBUG::2014-08-12 18:57:35,330::__init__::225::IOProcess::(_processLogs) (325) Got request for method 'rename' >Thread-15::DEBUG::2014-08-12 18:57:35,331::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-29::DEBUG::2014-08-12 18:57:35,331::__init__::225::IOProcess::(_processLogs) (325) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,332::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,332::__init__::225::IOProcess::(_processLogs) Message size is 70 >Thread-29::DEBUG::2014-08-12 18:57:35,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,333::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,333::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,333::__init__::225::IOProcess::(_processLogs) (326) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,333::__init__::225::IOProcess::(_processLogs) (326) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,334::__init__::225::IOProcess::(_processLogs) (326) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,334::__init__::225::IOProcess::(_processLogs) (326) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,334::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,334::__init__::225::IOProcess::(_processLogs) Message size is 74 >Thread-29::DEBUG::2014-08-12 18:57:35,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,335::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,336::__init__::225::IOProcess::(_processLogs) (327) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,336::__init__::225::IOProcess::(_processLogs) (327) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,336::__init__::225::IOProcess::(_processLogs) (327) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,336::__init__::225::IOProcess::(_processLogs) (327) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,336::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,337::__init__::225::IOProcess::(_processLogs) Message size is 86 >Thread-29::DEBUG::2014-08-12 18:57:35,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,338::__init__::225::IOProcess::(_processLogs) (328) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,338::__init__::225::IOProcess::(_processLogs) (328) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,338::__init__::225::IOProcess::(_processLogs) (328) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,338::__init__::225::IOProcess::(_processLogs) (328) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,339::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,339::__init__::225::IOProcess::(_processLogs) Message size is 90 >Thread-29::DEBUG::2014-08-12 18:57:35,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,340::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,340::__init__::225::IOProcess::(_processLogs) (329) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,340::__init__::225::IOProcess::(_processLogs) (329) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,341::__init__::225::IOProcess::(_processLogs) (329) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,341::__init__::225::IOProcess::(_processLogs) (329) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,341::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,341::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,341::__init__::225::IOProcess::(_processLogs) Message size is 143 >Thread-29::DEBUG::2014-08-12 18:57:35,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,343::__init__::225::IOProcess::(_processLogs) (330) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,343::__init__::225::IOProcess::(_processLogs) (330) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,343::__init__::225::IOProcess::(_processLogs) (330) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,343::__init__::225::IOProcess::(_processLogs) (330) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,344::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,344::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 18:57:35,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,345::__init__::225::IOProcess::(_processLogs) (331) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,345::__init__::225::IOProcess::(_processLogs) (331) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 18:57:35,345::__init__::225::IOProcess::(_processLogs) (331) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,345::__init__::225::IOProcess::(_processLogs) (331) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,346::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 18:57:35,346::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 18:57:35,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,347::__init__::225::IOProcess::(_processLogs) (332) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 18:57:35,347::__init__::225::IOProcess::(_processLogs) (332) Got request for method 'mkdir' >Thread-15::DEBUG::2014-08-12 18:57:35,347::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/68d897e0-6b30-4609-a78d-cdb2c1411233 >Thread-29::DEBUG::2014-08-12 18:57:35,348::__init__::225::IOProcess::(_processLogs) (332) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,348::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,349::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 18:57:35,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,349::__init__::225::IOProcess::(_processLogs) (333) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 18:57:35,350::__init__::225::IOProcess::(_processLogs) (333) Got request for method 'touch' >Thread-15::DEBUG::2014-08-12 18:57:35,350::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 18:57:35,350::__init__::225::IOProcess::(_processLogs) (333) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,351::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,351::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,351::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 18:57:35,352::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,352::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,352::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,352::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,352::__init__::225::IOProcess::(_processLogs) (334) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 18:57:35,352::__init__::225::IOProcess::(_processLogs) (334) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 18:57:35,353::__init__::225::IOProcess::(_processLogs) (334) Queuing response >Thread-15::DEBUG::2014-08-12 18:57:35,354::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=68d897e0-6b30-4609-a78d-cdb2c1411233', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=69d0ca1c99d46c3290667030af40f3b4370bbfe0'] >Thread-29::DEBUG::2014-08-12 18:57:35,354::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 18:57:35,355::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 18:57:35,355::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,356::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,356::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,356::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,356::__init__::225::IOProcess::(_processLogs) (335) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 18:57:35,357::__init__::225::IOProcess::(_processLogs) (335) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 18:57:35,357::__init__::225::IOProcess::(_processLogs) (335) Building response >Thread-29::DEBUG::2014-08-12 18:57:35,357::__init__::225::IOProcess::(_processLogs) (335) Queuing response >Thread-29::DEBUG::2014-08-12 18:57:35,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,357::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 18:57:35,357::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 18:57:35,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 18:57:35,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,358::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,358::__init__::225::IOProcess::(_processLogs) (336) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 18:57:35,358::__init__::225::IOProcess::(_processLogs) (336) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 18:57:35,359::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 18:57:35,359::__init__::225::IOProcess::(_processLogs) (336) Queuing response >Thread-15::DEBUG::2014-08-12 18:57:35,360::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '68d897e0-6b30-4609-a78d-cdb2c1411233_imageNS' >Thread-29::DEBUG::2014-08-12 18:57:35,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 18:57:35,361::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 18:57:35,361::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '68d897e0-6b30-4609-a78d-cdb2c1411233_volumeNS' >Thread-15::DEBUG::2014-08-12 18:57:35,361::clusterlock::143::Storage.initSANLock::(initSANLock) Initializing SANLock for domain 68d897e0-6b30-4609-a78d-cdb2c1411233 >Thread-15::DEBUG::2014-08-12 18:57:35,388::sd::443::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-15::DEBUG::2014-08-12 18:57:35,388::hsm::2685::Storage.HSM::(createStorageDomain) knownSDs: {880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 18:57:35,389::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-15::DEBUG::2014-08-12 18:57:35,389::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a20cd40-1ef5-4ac5-bdec-c085a6410765`::finished: None >Thread-15::DEBUG::2014-08-12 18:57:35,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a20cd40-1ef5-4ac5-bdec-c085a6410765`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:35,389::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:57:35,389::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:35,390::task::993::Storage.TaskManager.Task::(_decref) Task=`5a20cd40-1ef5-4ac5-bdec-c085a6410765`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:57:35,444::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [5bcc11b7] >Thread-15::DEBUG::2014-08-12 18:57:35,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`fdc05d4a-5b12-418a-a85b-db1138b91043`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:35,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='68d897e0-6b30-4609-a78d-cdb2c1411233', options=None) >Thread-15::DEBUG::2014-08-12 18:57:35,445::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.68d897e0-6b30-4609-a78d-cdb2c1411233`ReqID=`d79676f7-82b7-4152-bebb-1becaf521dba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2824' at 'getStorageDomainStats' >Thread-15::DEBUG::2014-08-12 18:57:35,445::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 18:57:35,445::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 18:57:35,445::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.68d897e0-6b30-4609-a78d-cdb2c1411233`ReqID=`d79676f7-82b7-4152-bebb-1becaf521dba`::Granted request >Thread-15::DEBUG::2014-08-12 18:57:35,446::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fdc05d4a-5b12-418a-a85b-db1138b91043`::_resourcesAcquired: Storage.68d897e0-6b30-4609-a78d-cdb2c1411233 (shared) >Thread-15::DEBUG::2014-08-12 18:57:35,446::task::993::Storage.TaskManager.Task::(_decref) Task=`fdc05d4a-5b12-418a-a85b-db1138b91043`::ref 1 aborting False >Thread-29::DEBUG::2014-08-12 18:57:35,446::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 18:57:35,447::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 18:57:35,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 18:57:35,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 18:57:35,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 18:57:35,447::__init__::225::IOProcess::(_processLogs) (337) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 18:57:35,447::__init__::225::IOProcess::(_processLogs) (337) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 18:57:35,448::__init__::225::IOProcess::(_processLogs) (337) Queuing response >Thread-15::INFO::2014-08-12 18:57:35,448::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21472411648', 'disktotal': '21474836480', 'mdafree': 0}} >Thread-29::DEBUG::2014-08-12 18:57:35,449::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 18:57:35,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`fdc05d4a-5b12-418a-a85b-db1138b91043`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21472411648', 'disktotal': '21474836480', 'mdafree': 0}} >Thread-29::DEBUG::2014-08-12 18:57:35,449::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 18:57:35,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`fdc05d4a-5b12-418a-a85b-db1138b91043`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:35,450::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233': < ResourceRef 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 18:57:35,450::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:35,450::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' >Thread-15::DEBUG::2014-08-12 18:57:35,451::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' (0 active users) >Thread-15::DEBUG::2014-08-12 18:57:35,451::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 18:57:35,451::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233', Clearing records. >Thread-15::DEBUG::2014-08-12 18:57:35,451::task::993::Storage.TaskManager.Task::(_decref) Task=`fdc05d4a-5b12-418a-a85b-db1138b91043`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 18:57:36,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`cde15461-890c-47cb-b145-a126035ae305`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:36,970::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:57:36,971::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613125', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692377', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:57:36,971::task::1191::Storage.TaskManager.Task::(prepare) Task=`cde15461-890c-47cb-b145-a126035ae305`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613125', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692377', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:57:36,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`cde15461-890c-47cb-b145-a126035ae305`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:36,971::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:57:36,971::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:36,972::task::993::Storage.TaskManager.Task::(_decref) Task=`cde15461-890c-47cb-b145-a126035ae305`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:57:40,094::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:57:40,095::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:57:40,273::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:57:40,274::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:57:40,274::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:57:40,283::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571579 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:57:40,498::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:57:40,498::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 18:57:40,681::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:57:40,682::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:57:40,682::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:57:40,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683395 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:57:50,286::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:57:50,295::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673583 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:57:50,694::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:57:50,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614945 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:57:52,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`d081350a-1592-460d-844f-81cb51c22f33`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:57:52,098::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:57:52,098::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673583', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614945', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:57:52,098::task::1191::Storage.TaskManager.Task::(prepare) Task=`d081350a-1592-460d-844f-81cb51c22f33`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673583', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614945', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:57:52,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`d081350a-1592-460d-844f-81cb51c22f33`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:57:52,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:57:52,099::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:57:52,099::task::993::Storage.TaskManager.Task::(_decref) Task=`d081350a-1592-460d-844f-81cb51c22f33`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:58:00,297::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:58:00,310::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592905 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:58:00,708::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:58:00,717::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739318 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:58:07,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b4f6fe8-12e5-441b-aefc-19910cd78789`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:58:07,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:58:07,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592905', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739318', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:58:07,201::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b4f6fe8-12e5-441b-aefc-19910cd78789`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592905', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739318', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:58:07,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b4f6fe8-12e5-441b-aefc-19910cd78789`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:58:07,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:58:07,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:58:07,201::task::993::Storage.TaskManager.Task::(_decref) Task=`5b4f6fe8-12e5-441b-aefc-19910cd78789`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:58:10,313::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:58:10,321::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638269 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:58:10,720::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:58:10,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656187 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:58:20,323::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:58:20,331::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596095 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:58:20,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:58:20,741::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065431 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:58:22,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`675d9485-c9f6-438c-98c0-1329237f59ed`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:58:22,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:58:22,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596095', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065431', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:58:22,312::task::1191::Storage.TaskManager.Task::(prepare) Task=`675d9485-c9f6-438c-98c0-1329237f59ed`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596095', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065431', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:58:22,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`675d9485-c9f6-438c-98c0-1329237f59ed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:58:22,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:58:22,313::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:58:22,313::task::993::Storage.TaskManager.Task::(_decref) Task=`675d9485-c9f6-438c-98c0-1329237f59ed`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:58:30,333::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:58:30,341::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651833 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:58:30,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:58:30,753::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650878 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:58:37,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0ebe207-665f-4e59-a416-60fe48935ffd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:58:37,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:58:37,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651833', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650878', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:58:37,429::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0ebe207-665f-4e59-a416-60fe48935ffd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651833', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650878', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:58:37,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0ebe207-665f-4e59-a416-60fe48935ffd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:58:37,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:58:37,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:58:37,430::task::993::Storage.TaskManager.Task::(_decref) Task=`d0ebe207-665f-4e59-a416-60fe48935ffd`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:58:40,343::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:58:40,351::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698808 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:58:40,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:58:40,765::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693714 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:58:50,354::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:58:50,363::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606694 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:58:50,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:58:50,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000984579 s, 4.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:58:52,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf0d7d5f-695c-4f54-a276-5ea9cff98621`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:58:52,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:58:52,541::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606694', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000984579', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:58:52,542::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf0d7d5f-695c-4f54-a276-5ea9cff98621`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606694', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000984579', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:58:52,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf0d7d5f-695c-4f54-a276-5ea9cff98621`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:58:52,543::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:58:52,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:58:52,544::task::993::Storage.TaskManager.Task::(_decref) Task=`cf0d7d5f-695c-4f54-a276-5ea9cff98621`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:59:00,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:00,373::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679088 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:00,785::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:00,794::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701981 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:59:07,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`93b8177d-27f2-442b-a978-c7a9e5917e12`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:59:07,676::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:59:07,676::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679088', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701981', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:59:07,677::task::1191::Storage.TaskManager.Task::(prepare) Task=`93b8177d-27f2-442b-a978-c7a9e5917e12`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679088', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701981', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:59:07,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`93b8177d-27f2-442b-a978-c7a9e5917e12`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:59:07,677::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:59:07,677::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:59:07,677::task::993::Storage.TaskManager.Task::(_decref) Task=`93b8177d-27f2-442b-a978-c7a9e5917e12`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:59:10,374::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 18:59:10,375::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:59:10,375::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:10,384::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000757556 s, 2.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:59:10,384::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000757556 s, 2.7 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 18:59:10,384::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 18:59:10,384::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 18:59:10,385::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 18:59:10,385::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:59:10,385::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:59:10,385::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:59:10,386::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:59:10,386::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 18:59:10,386::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:10,653::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:59:10,654::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 18:59:10,654::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 18:59:10,656::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 18:59:10,656::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 18:59:10,656::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 18:59:10,656::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:10,797::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 18:59:10,797::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:59:10,798::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:10,807::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000713572 s, 2.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:10,807::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000713572 s, 2.9 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 18:59:10,807::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 18:59:10,807::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 18:59:10,808::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 18:59:10,808::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:59:10,808::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:59:10,809::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:59:10,809::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:59:10,809::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 18:59:10,809::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:10,824::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:59:10,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:10,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614692 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:10,993::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:10,994::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 18:59:10,994::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 18:59:10,995::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 18:59:10,995::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 18:59:10,995::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 18:59:10,996::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:11,162::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:11,163::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:11,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000573658 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:59:20,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:20,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112192 s, 3.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:21,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:21,184::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617649 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:59:22,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`884e3083-13c5-468a-b441-6fde685710c8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:59:22,810::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:59:22,811::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112192', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617649', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:59:22,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`884e3083-13c5-468a-b441-6fde685710c8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112192', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617649', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:59:22,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`884e3083-13c5-468a-b441-6fde685710c8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:59:22,812::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:59:22,813::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:59:22,813::task::993::Storage.TaskManager.Task::(_decref) Task=`884e3083-13c5-468a-b441-6fde685710c8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:59:30,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:30,855::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737701 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:31,187::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:31,195::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621275 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:59:37,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`878aaec9-1798-42c2-bc2c-cdddbac88670`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:59:37,934::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:59:37,934::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737701', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621275', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:59:37,934::task::1191::Storage.TaskManager.Task::(prepare) Task=`878aaec9-1798-42c2-bc2c-cdddbac88670`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737701', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621275', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:59:37,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`878aaec9-1798-42c2-bc2c-cdddbac88670`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:59:37,934::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:59:37,934::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:59:37,935::task::993::Storage.TaskManager.Task::(_decref) Task=`878aaec9-1798-42c2-bc2c-cdddbac88670`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 18:59:40,857::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:40,865::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645032 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:41,199::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:41,206::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673471 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 18:59:50,867::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 18:59:50,875::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610616 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 18:59:51,210::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 18:59:51,219::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638193 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 18:59:53,044::task::595::Storage.TaskManager.Task::(_updateState) Task=`9359adaf-90a2-432d-bf01-8606eeb51345`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 18:59:53,045::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 18:59:53,046::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610616', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638193', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:59:53,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`9359adaf-90a2-432d-bf01-8606eeb51345`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610616', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638193', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 18:59:53,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`9359adaf-90a2-432d-bf01-8606eeb51345`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 18:59:53,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 18:59:53,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 18:59:53,049::task::993::Storage.TaskManager.Task::(_decref) Task=`9359adaf-90a2-432d-bf01-8606eeb51345`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:00:00,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:00:00,885::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059996 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:00:01,222::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:00:01,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756036 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:00:08,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`68a3ccfe-944c-4e5f-8315-398fdbb41801`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:00:08,175::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:00:08,176::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059996', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756036', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:00:08,176::task::1191::Storage.TaskManager.Task::(prepare) Task=`68a3ccfe-944c-4e5f-8315-398fdbb41801`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059996', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756036', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:00:08,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`68a3ccfe-944c-4e5f-8315-398fdbb41801`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:00:08,176::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:00:08,176::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:00:08,177::task::993::Storage.TaskManager.Task::(_decref) Task=`68a3ccfe-944c-4e5f-8315-398fdbb41801`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:00:10,887::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:00:10,896::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643945 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:00:11,234::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:00:11,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628607 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:00:20,898::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:00:20,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614279 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:00:21,250::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:00:21,259::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593064 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:00:23,301::task::595::Storage.TaskManager.Task::(_updateState) Task=`e064a14b-7cdf-40d9-b0f9-0950849c0294`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:00:23,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:00:23,303::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614279', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593064', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:00:23,304::task::1191::Storage.TaskManager.Task::(prepare) Task=`e064a14b-7cdf-40d9-b0f9-0950849c0294`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614279', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593064', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:00:23,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`e064a14b-7cdf-40d9-b0f9-0950849c0294`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:00:23,305::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:00:23,305::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:00:23,306::task::993::Storage.TaskManager.Task::(_decref) Task=`e064a14b-7cdf-40d9-b0f9-0950849c0294`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:00:30,912::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:00:30,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079813 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:00:31,262::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:00:31,270::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635224 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:00:38,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5fd65ee-4f95-4deb-aaa6-13554b9ad4ac`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:00:38,476::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:00:38,476::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079813', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635224', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:00:38,477::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5fd65ee-4f95-4deb-aaa6-13554b9ad4ac`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079813', 'lastCheck': '7.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635224', 'lastCheck': '7.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:00:38,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5fd65ee-4f95-4deb-aaa6-13554b9ad4ac`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:00:38,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:00:38,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:00:38,477::task::993::Storage.TaskManager.Task::(_decref) Task=`d5fd65ee-4f95-4deb-aaa6-13554b9ad4ac`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:00:40,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:00:40,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784141 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:00:41,273::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:00:41,281::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673379 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:00:50,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:00:50,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680995 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:00:51,284::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:00:51,293::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058605 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:00:53,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd491822-61a0-4e0e-bcd7-94feedca3338`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:00:53,590::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:00:53,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680995', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058605', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:00:53,590::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd491822-61a0-4e0e-bcd7-94feedca3338`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680995', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058605', 'lastCheck': '2.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:00:53,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd491822-61a0-4e0e-bcd7-94feedca3338`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:00:53,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:00:53,591::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:00:53,591::task::993::Storage.TaskManager.Task::(_decref) Task=`cd491822-61a0-4e0e-bcd7-94feedca3338`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:01:00,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:01:00,951::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000755992 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:01:01,296::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:01:01,305::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00146899 s, 2.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:01:08,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed36ab9-0b03-4773-a76d-30021f1a54b0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:01:08,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:01:08,700::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000755992', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146899', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:01:08,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ed36ab9-0b03-4773-a76d-30021f1a54b0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000755992', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146899', 'lastCheck': '7.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:01:08,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed36ab9-0b03-4773-a76d-30021f1a54b0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:01:08,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:01:08,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:01:08,701::task::993::Storage.TaskManager.Task::(_decref) Task=`9ed36ab9-0b03-4773-a76d-30021f1a54b0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:01:10,952::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:01:10,967::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599106 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:01:11,309::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:01:11,317::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006664 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:01:20,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:01:20,977::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058765 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:01:21,320::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:01:21,332::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00349552 s, 1.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:01:23,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd597b61-197c-40fa-a35c-9910f1f4fd1d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:01:23,812::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:01:23,813::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058765', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00349552', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:01:23,813::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd597b61-197c-40fa-a35c-9910f1f4fd1d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058765', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00349552', 'lastCheck': '2.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:01:23,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd597b61-197c-40fa-a35c-9910f1f4fd1d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:01:23,813::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:01:23,813::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:01:23,814::task::993::Storage.TaskManager.Task::(_decref) Task=`fd597b61-197c-40fa-a35c-9910f1f4fd1d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:01:30,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:01:30,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066094 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:01:31,336::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:01:31,344::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660453 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:01:38,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9a9c153-3203-48a4-84c2-5a240c1bacb7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:01:38,934::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:01:38,934::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066094', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660453', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:01:38,934::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9a9c153-3203-48a4-84c2-5a240c1bacb7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066094', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660453', 'lastCheck': '7.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:01:38,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9a9c153-3203-48a4-84c2-5a240c1bacb7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:01:38,934::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:01:38,935::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:01:38,935::task::993::Storage.TaskManager.Task::(_decref) Task=`c9a9c153-3203-48a4-84c2-5a240c1bacb7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:01:40,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:01:40,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000813572 s, 5.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:01:41,349::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:01:41,357::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685503 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:01:50,998::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:01:51,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604485 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:01:51,366::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:01:51,375::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576808 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:01:54,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`5318dfb9-4a06-4772-9a18-45e3990d274d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:01:54,049::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:01:54,050::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604485', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576808', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:01:54,050::task::1191::Storage.TaskManager.Task::(prepare) Task=`5318dfb9-4a06-4772-9a18-45e3990d274d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604485', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576808', 'lastCheck': '2.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:01:54,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`5318dfb9-4a06-4772-9a18-45e3990d274d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:01:54,050::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:01:54,050::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:01:54,050::task::993::Storage.TaskManager.Task::(_decref) Task=`5318dfb9-4a06-4772-9a18-45e3990d274d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:02:01,010::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:02:01,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617188 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:02:01,379::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:02:01,386::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063124 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:02:09,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`31e8d677-e055-4522-abb8-accf8e0481df`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:02:09,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:02:09,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617188', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063124', 'lastCheck': '7.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:02:09,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`31e8d677-e055-4522-abb8-accf8e0481df`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617188', 'lastCheck': '8.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063124', 'lastCheck': '7.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:02:09,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`31e8d677-e055-4522-abb8-accf8e0481df`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:02:09,194::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:02:09,194::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:02:09,195::task::993::Storage.TaskManager.Task::(_decref) Task=`31e8d677-e055-4522-abb8-accf8e0481df`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:02:11,020::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:02:11,029::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603585 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:02:11,390::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:02:11,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061936 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:02:21,030::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:02:21,039::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066926 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:02:21,400::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:02:21,409::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600984 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:02:24,301::task::595::Storage.TaskManager.Task::(_updateState) Task=`a07e626f-c3b2-4174-a201-d18d54c013f6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:02:24,301::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:02:24,301::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066926', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600984', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:02:24,302::task::1191::Storage.TaskManager.Task::(prepare) Task=`a07e626f-c3b2-4174-a201-d18d54c013f6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066926', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600984', 'lastCheck': '2.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:02:24,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`a07e626f-c3b2-4174-a201-d18d54c013f6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:02:24,302::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:02:24,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:02:24,302::task::993::Storage.TaskManager.Task::(_decref) Task=`a07e626f-c3b2-4174-a201-d18d54c013f6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:02:31,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:02:31,049::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621946 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:02:31,412::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:02:31,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000550366 s, 7.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:02:39,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f4e4068-8c65-4b4c-881e-c60321334a1e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:02:39,459::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:02:39,459::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621946', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550366', 'lastCheck': '8.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:02:39,459::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f4e4068-8c65-4b4c-881e-c60321334a1e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621946', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550366', 'lastCheck': '8.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:02:39,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f4e4068-8c65-4b4c-881e-c60321334a1e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:02:39,460::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:02:39,460::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:02:39,460::task::993::Storage.TaskManager.Task::(_decref) Task=`4f4e4068-8c65-4b4c-881e-c60321334a1e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:02:41,051::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:02:41,059::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589503 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:02:41,423::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:02:41,431::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0005557 s, 7.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:02:51,061::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:02:51,070::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641884 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:02:51,434::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:02:51,444::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062492 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:02:54,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ee22c29-3ef7-4d0d-9096-c01b9987ea9c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:02:54,570::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:02:54,570::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641884', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062492', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:02:54,571::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ee22c29-3ef7-4d0d-9096-c01b9987ea9c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641884', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00062492', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:02:54,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ee22c29-3ef7-4d0d-9096-c01b9987ea9c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:02:54,571::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:02:54,571::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:02:54,571::task::993::Storage.TaskManager.Task::(_decref) Task=`2ee22c29-3ef7-4d0d-9096-c01b9987ea9c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:03:01,071::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:03:01,081::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598693 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:03:01,448::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:03:01,455::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580024 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:03:09,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4a1fc91-c75f-4bad-ac1b-5c573f5c81a7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:03:09,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:03:09,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598693', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580024', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:03:09,691::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4a1fc91-c75f-4bad-ac1b-5c573f5c81a7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598693', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580024', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:03:09,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4a1fc91-c75f-4bad-ac1b-5c573f5c81a7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:03:09,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:03:09,693::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:03:09,693::task::993::Storage.TaskManager.Task::(_decref) Task=`b4a1fc91-c75f-4bad-ac1b-5c573f5c81a7`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:03:11,083::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:03:11,091::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830591 s, 4.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:03:11,459::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:03:11,466::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683182 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:03:21,093::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:03:21,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612497 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:03:21,469::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:03:21,478::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603913 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:03:24,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eaef719-f3bc-4e20-93cd-efc80fe2167f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:03:24,811::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:03:24,811::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612497', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603913', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:03:24,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`4eaef719-f3bc-4e20-93cd-efc80fe2167f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612497', 'lastCheck': '3.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603913', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:03:24,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eaef719-f3bc-4e20-93cd-efc80fe2167f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:03:24,811::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:03:24,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:03:24,812::task::993::Storage.TaskManager.Task::(_decref) Task=`4eaef719-f3bc-4e20-93cd-efc80fe2167f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:03:31,103::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:03:31,111::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746469 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:03:31,482::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:03:31,490::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074606 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:03:39,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`e172b074-9efd-4113-b02f-9f3f94f102c9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:03:39,919::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:03:39,920::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746469', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074606', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:03:39,920::task::1191::Storage.TaskManager.Task::(prepare) Task=`e172b074-9efd-4113-b02f-9f3f94f102c9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746469', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074606', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:03:39,920::task::595::Storage.TaskManager.Task::(_updateState) Task=`e172b074-9efd-4113-b02f-9f3f94f102c9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:03:39,920::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:03:39,920::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:03:39,920::task::993::Storage.TaskManager.Task::(_decref) Task=`e172b074-9efd-4113-b02f-9f3f94f102c9`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:03:41,113::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:03:41,122::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632979 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:03:41,493::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:03:41,500::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666475 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:03:51,123::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:03:51,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713812 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:03:51,503::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:03:51,511::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665582 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:03:55,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ed37bd9-4535-42c0-b724-15cb1b69b194`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:03:55,026::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:03:55,026::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713812', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665582', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:03:55,026::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ed37bd9-4535-42c0-b724-15cb1b69b194`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713812', 'lastCheck': '3.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665582', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:03:55,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ed37bd9-4535-42c0-b724-15cb1b69b194`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:03:55,027::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:03:55,027::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:03:55,027::task::993::Storage.TaskManager.Task::(_decref) Task=`4ed37bd9-4535-42c0-b724-15cb1b69b194`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:04:01,134::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:01,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068571 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:01,514::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:01,523::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649185 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:04:10,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e552c47-a164-4398-8fa7-4ae4b4e8f4ba`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:04:10,152::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:04:10,152::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068571', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649185', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:04:10,152::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e552c47-a164-4398-8fa7-4ae4b4e8f4ba`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068571', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649185', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:04:10,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e552c47-a164-4398-8fa7-4ae4b4e8f4ba`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:04:10,153::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:04:10,153::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:04:10,153::task::993::Storage.TaskManager.Task::(_decref) Task=`3e552c47-a164-4398-8fa7-4ae4b4e8f4ba`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:04:11,144::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 19:04:11,145::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:04:11,145::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:11,154::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000705664 s, 2.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:04:11,154::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000705664 s, 2.9 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:04:11,154::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:04:11,154::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:04:11,155::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:04:11,155::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:04:11,155::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:04:11,156::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:04:11,156::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:04:11,156::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:04:11,156::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:11,447::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:04:11,447::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:04:11,448::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 19:04:11,449::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 19:04:11,449::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:04:11,449::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 19:04:11,450::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:11,526::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 19:04:11,527::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:04:11,527::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:11,538::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00066386 s, 3.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:11,538::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00066386 s, 3.1 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 19:04:11,538::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 19:04:11,539::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 19:04:11,539::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:04:11,539::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:04:11,539::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:04:11,540::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:04:11,540::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:04:11,540::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:04:11,540::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:11,622::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:04:11,622::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:11,631::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600175 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:11,716::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:11,717::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:04:11,717::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 19:04:11,718::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 19:04:11,718::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 19:04:11,718::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:04:11,719::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:11,887::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:11,888::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:11,896::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668117 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:04:21,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:21,643::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673897 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:21,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:21,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717004 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:04:25,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`60af442e-4415-429e-bce0-709213af89e0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:04:25,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:04:25,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673897', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717004', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:04:25,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`60af442e-4415-429e-bce0-709213af89e0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673897', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717004', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:04:25,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`60af442e-4415-429e-bce0-709213af89e0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:04:25,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:04:25,259::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:04:25,260::task::993::Storage.TaskManager.Task::(_decref) Task=`60af442e-4415-429e-bce0-709213af89e0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:04:31,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:31,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715915 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:31,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:31,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000783175 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:04:40,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`35487b8a-ec53-46c5-8b7c-211bbf70a1b9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:04:40,363::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:04:40,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715915', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783175', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:04:40,363::task::1191::Storage.TaskManager.Task::(prepare) Task=`35487b8a-ec53-46c5-8b7c-211bbf70a1b9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000715915', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000783175', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:04:40,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`35487b8a-ec53-46c5-8b7c-211bbf70a1b9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:04:40,363::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:04:40,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:04:40,364::task::993::Storage.TaskManager.Task::(_decref) Task=`35487b8a-ec53-46c5-8b7c-211bbf70a1b9`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:04:41,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:41,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719519 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:41,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:41,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710112 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:04:51,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:04:51,673::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700623 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:04:51,934::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:04:51,941::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784675 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:04:55,473::task::595::Storage.TaskManager.Task::(_updateState) Task=`3811e959-12e2-49fe-b2b6-0f09a9bcf6cb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:04:55,473::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:04:55,473::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700623', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784675', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:04:55,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`3811e959-12e2-49fe-b2b6-0f09a9bcf6cb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700623', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784675', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:04:55,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`3811e959-12e2-49fe-b2b6-0f09a9bcf6cb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:04:55,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:04:55,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:04:55,474::task::993::Storage.TaskManager.Task::(_decref) Task=`3811e959-12e2-49fe-b2b6-0f09a9bcf6cb`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:05:01,675::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:05:01,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653469 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:05:01,945::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:05:01,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645492 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:05:10,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`b732f414-b207-424c-94ce-a5e6f892b134`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:05:10,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:05:10,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653469', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645492', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:05:10,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`b732f414-b207-424c-94ce-a5e6f892b134`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653469', 'lastCheck': '8.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645492', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:05:10,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`b732f414-b207-424c-94ce-a5e6f892b134`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:05:10,578::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:05:10,578::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:05:10,578::task::993::Storage.TaskManager.Task::(_decref) Task=`b732f414-b207-424c-94ce-a5e6f892b134`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:05:11,685::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:05:11,708::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0152673 s, 268 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:05:11,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:05:11,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785357 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:05:21,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:05:21,719::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716007 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:05:21,968::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:05:21,975::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635262 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:05:25,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`2252b5b9-af01-4c86-a74b-1b16cb3c2d3c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:05:25,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:05:25,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716007', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635262', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:05:25,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`2252b5b9-af01-4c86-a74b-1b16cb3c2d3c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716007', 'lastCheck': '4.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635262', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:05:25,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`2252b5b9-af01-4c86-a74b-1b16cb3c2d3c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:05:25,690::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:05:25,691::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:05:25,691::task::993::Storage.TaskManager.Task::(_decref) Task=`2252b5b9-af01-4c86-a74b-1b16cb3c2d3c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:05:31,721::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:05:31,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000691 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:05:31,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:05:31,987::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623009 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:05:40,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c128f75-9df5-403e-baa7-95f3fb66f3f0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:05:40,795::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:05:40,795::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623009', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:05:40,795::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c128f75-9df5-403e-baa7-95f3fb66f3f0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000691', 'lastCheck': '9.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623009', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:05:40,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c128f75-9df5-403e-baa7-95f3fb66f3f0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:05:40,796::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:05:40,796::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:05:40,796::task::993::Storage.TaskManager.Task::(_decref) Task=`6c128f75-9df5-403e-baa7-95f3fb66f3f0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:05:41,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:05:41,738::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678204 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:05:41,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:05:41,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660988 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:05:51,740::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:05:51,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626529 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:05:52,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:05:52,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705056 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:05:55,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`a521fb99-4c6c-42ad-87f6-29e85718a6eb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:05:55,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:05:55,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626529', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705056', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:05:55,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`a521fb99-4c6c-42ad-87f6-29e85718a6eb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626529', 'lastCheck': '4.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705056', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:05:55,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`a521fb99-4c6c-42ad-87f6-29e85718a6eb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:05:55,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:05:55,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:05:55,908::task::993::Storage.TaskManager.Task::(_decref) Task=`a521fb99-4c6c-42ad-87f6-29e85718a6eb`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:06:01,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:06:01,759::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741984 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:06:02,012::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:06:02,021::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760001 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:06:11,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eccfb53-bf67-43cd-b320-684f1ec6f560`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:06:11,019::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:06:11,019::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741984', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760001', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:06:11,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`6eccfb53-bf67-43cd-b320-684f1ec6f560`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000741984', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760001', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:06:11,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eccfb53-bf67-43cd-b320-684f1ec6f560`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:06:11,020::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:06:11,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:06:11,020::task::993::Storage.TaskManager.Task::(_decref) Task=`6eccfb53-bf67-43cd-b320-684f1ec6f560`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:06:11,761::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:06:11,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728615 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:06:12,024::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:06:12,032::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660388 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:06:21,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:06:21,781::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000775485 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:06:22,035::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:06:22,043::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636662 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:06:26,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a7609fa-4283-463f-9c64-355a280c95a6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:06:26,140::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:06:26,140::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775485', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636662', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:06:26,140::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a7609fa-4283-463f-9c64-355a280c95a6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000775485', 'lastCheck': '4.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636662', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:06:26,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a7609fa-4283-463f-9c64-355a280c95a6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:06:26,141::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:06:26,141::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:06:26,141::task::993::Storage.TaskManager.Task::(_decref) Task=`6a7609fa-4283-463f-9c64-355a280c95a6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:06:31,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:06:31,790::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690978 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:06:32,046::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:06:32,055::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636342 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:06:41,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0e079cf-b823-48bf-a44a-465a84b4a876`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:06:41,241::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:06:41,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690978', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636342', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:06:41,242::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0e079cf-b823-48bf-a44a-465a84b4a876`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690978', 'lastCheck': '9.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636342', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:06:41,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0e079cf-b823-48bf-a44a-465a84b4a876`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:06:41,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:06:41,242::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:06:41,243::task::993::Storage.TaskManager.Task::(_decref) Task=`d0e079cf-b823-48bf-a44a-465a84b4a876`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:06:41,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:06:41,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712031 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:06:42,058::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:06:42,066::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735209 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:06:51,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:06:51,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666349 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:06:52,069::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:06:52,076::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643238 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:06:56,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`739a6213-21fd-43b6-a09c-bb121e25168d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:06:56,350::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:06:56,350::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666349', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643238', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:06:56,350::task::1191::Storage.TaskManager.Task::(prepare) Task=`739a6213-21fd-43b6-a09c-bb121e25168d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666349', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643238', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:06:56,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`739a6213-21fd-43b6-a09c-bb121e25168d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:06:56,350::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:06:56,351::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:06:56,351::task::993::Storage.TaskManager.Task::(_decref) Task=`739a6213-21fd-43b6-a09c-bb121e25168d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:07:01,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:07:01,824::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770654 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:07:02,080::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:07:02,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064402 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:07:11,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`206234a0-e282-4a89-b149-bbff61e5e480`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:07:11,471::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:07:11,471::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770654', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064402', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:07:11,471::task::1191::Storage.TaskManager.Task::(prepare) Task=`206234a0-e282-4a89-b149-bbff61e5e480`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770654', 'lastCheck': '9.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064402', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:07:11,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`206234a0-e282-4a89-b149-bbff61e5e480`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:07:11,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:07:11,472::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:07:11,472::task::993::Storage.TaskManager.Task::(_decref) Task=`206234a0-e282-4a89-b149-bbff61e5e480`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:07:11,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:07:11,842::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690843 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:07:12,092::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:07:12,100::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729145 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:07:21,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:07:21,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652817 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:07:22,104::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:07:22,112::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617242 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:07:26,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbfec2af-c238-4158-9e29-eef3f5e11b11`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:07:26,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:07:26,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652817', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617242', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:07:26,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbfec2af-c238-4158-9e29-eef3f5e11b11`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652817', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617242', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:07:26,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbfec2af-c238-4158-9e29-eef3f5e11b11`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:07:26,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:07:26,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:07:26,589::task::993::Storage.TaskManager.Task::(_decref) Task=`cbfec2af-c238-4158-9e29-eef3f5e11b11`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:07:31,854::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:07:31,863::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668543 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:07:32,115::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:07:32,124::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764471 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:07:41,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`4da5127c-0c63-466e-9f2d-7ff5e6b67023`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:07:41,693::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:07:41,693::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668543', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764471', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:07:41,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`4da5127c-0c63-466e-9f2d-7ff5e6b67023`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668543', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764471', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:07:41,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`4da5127c-0c63-466e-9f2d-7ff5e6b67023`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:07:41,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:07:41,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:07:41,694::task::993::Storage.TaskManager.Task::(_decref) Task=`4da5127c-0c63-466e-9f2d-7ff5e6b67023`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:07:41,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:07:41,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670252 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:07:42,128::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:07:42,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000744698 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:07:51,886::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:07:51,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00071055 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:07:52,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:07:52,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754756 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:07:56,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`e01fee3c-066a-4abb-a907-863a75f8281d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:07:56,807::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:07:56,808::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071055', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754756', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:07:56,808::task::1191::Storage.TaskManager.Task::(prepare) Task=`e01fee3c-066a-4abb-a907-863a75f8281d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00071055', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000754756', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:07:56,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`e01fee3c-066a-4abb-a907-863a75f8281d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:07:56,808::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:07:56,808::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:07:56,808::task::993::Storage.TaskManager.Task::(_decref) Task=`e01fee3c-066a-4abb-a907-863a75f8281d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:08:01,897::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:08:01,905::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702425 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:08:02,151::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:08:02,159::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668055 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:08:11,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:08:11,915::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740185 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:08:11,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec964082-5865-45c6-8c63-e774352e3317`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:08:11,921::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:08:11,922::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740185', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668055', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:08:11,922::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec964082-5865-45c6-8c63-e774352e3317`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740185', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668055', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:08:11,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec964082-5865-45c6-8c63-e774352e3317`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:08:11,922::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:08:11,922::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:08:11,922::task::993::Storage.TaskManager.Task::(_decref) Task=`ec964082-5865-45c6-8c63-e774352e3317`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:08:12,163::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:08:12,171::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703038 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:08:21,917::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:08:21,926::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654013 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:08:22,174::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:08:22,181::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598633 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:08:27,033::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc350431-37f5-48f3-af8f-3e4675bd37ac`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:08:27,033::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:08:27,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654013', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598633', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:08:27,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc350431-37f5-48f3-af8f-3e4675bd37ac`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654013', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598633', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:08:27,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc350431-37f5-48f3-af8f-3e4675bd37ac`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:08:27,034::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:08:27,034::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:08:27,034::task::993::Storage.TaskManager.Task::(_decref) Task=`bc350431-37f5-48f3-af8f-3e4675bd37ac`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:08:31,928::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:08:31,936::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653606 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:08:32,185::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:08:32,194::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650769 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:08:41,938::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:08:41,946::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700318 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:08:42,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ef293c4-1eb9-4401-bd63-f191cf83cf11`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:08:42,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:08:42,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700318', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650769', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:08:42,137::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ef293c4-1eb9-4401-bd63-f191cf83cf11`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700318', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650769', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:08:42,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ef293c4-1eb9-4401-bd63-f191cf83cf11`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:08:42,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:08:42,137::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:08:42,137::task::993::Storage.TaskManager.Task::(_decref) Task=`7ef293c4-1eb9-4401-bd63-f191cf83cf11`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:08:42,197::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:08:42,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061983 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:08:51,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:08:51,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666923 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:08:52,208::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:08:52,215::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664786 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:08:57,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`e546a668-fc0d-49c7-8876-ac2ec1b3f47a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:08:57,238::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:08:57,239::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666923', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664786', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:08:57,239::task::1191::Storage.TaskManager.Task::(prepare) Task=`e546a668-fc0d-49c7-8876-ac2ec1b3f47a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000666923', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664786', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:08:57,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`e546a668-fc0d-49c7-8876-ac2ec1b3f47a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:08:57,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:08:57,239::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:08:57,240::task::993::Storage.TaskManager.Task::(_decref) Task=`e546a668-fc0d-49c7-8876-ac2ec1b3f47a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:09:01,959::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:09:01,967::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608826 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:02,228::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:02,237::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667063 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:09:11,968::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 19:09:11,969::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:09:11,969::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:09:11,978::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00067667 s, 3.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:09:11,978::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00067667 s, 3.0 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:09:11,978::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:09:11,978::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:09:11,979::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:09:11,979::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:09:11,979::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:09:11,979::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:09:11,980::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:09:11,980::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:09:11,980::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 19:09:12,225::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:09:12,226::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:09:12,226::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 19:09:12,227::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 19:09:12,228::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:09:12,228::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 19:09:12,228::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:12,240::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 19:09:12,241::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:09:12,241::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:12,250::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000602187 s, 3.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:12,250::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000602187 s, 3.4 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 19:09:12,251::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 19:09:12,251::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 19:09:12,251::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:09:12,251::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:09:12,252::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:09:12,252::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:09:12,252::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:09:12,252::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:09:12,253::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 19:09:12,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`5892f684-b9c5-4e60-8b65-c8807155dd84`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:09:12,382::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:09:12,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608826', 'lastCheck': '10.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667063', 'lastCheck': '10.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:09:12,382::task::1191::Storage.TaskManager.Task::(prepare) Task=`5892f684-b9c5-4e60-8b65-c8807155dd84`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608826', 'lastCheck': '10.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667063', 'lastCheck': '10.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:09:12,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`5892f684-b9c5-4e60-8b65-c8807155dd84`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:09:12,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:09:12,383::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:09:12,383::task::993::Storage.TaskManager.Task::(_decref) Task=`5892f684-b9c5-4e60-8b65-c8807155dd84`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:09:12,397::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:09:12,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:09:12,407::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648652 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:12,438::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:12,441::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:09:12,444::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 19:09:12,446::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 19:09:12,446::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 19:09:12,447::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:09:12,447::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:12,617::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:12,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:12,628::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059688 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:09:22,410::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:09:22,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591791 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:22,632::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:22,642::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000884756 s, 4.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:09:27,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`b04ede62-543f-41b7-bf68-924917bb2c6d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:09:27,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:09:27,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591791', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000884756', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:09:27,567::task::1191::Storage.TaskManager.Task::(prepare) Task=`b04ede62-543f-41b7-bf68-924917bb2c6d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000591791', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000884756', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:09:27,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`b04ede62-543f-41b7-bf68-924917bb2c6d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:09:27,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:09:27,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:09:27,568::task::993::Storage.TaskManager.Task::(_decref) Task=`b04ede62-543f-41b7-bf68-924917bb2c6d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:09:32,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:09:32,432::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000745135 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:32,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:32,663::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000763063 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:09:42,439::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:09:42,447::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067218 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:42,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:42,673::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633764 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:09:42,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`e379bca5-9f30-411c-882f-9fc1dc8392e0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:09:42,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:09:42,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067218', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633764', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:09:42,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`e379bca5-9f30-411c-882f-9fc1dc8392e0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067218', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633764', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:09:42,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`e379bca5-9f30-411c-882f-9fc1dc8392e0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:09:42,691::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:09:42,691::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:09:42,691::task::993::Storage.TaskManager.Task::(_decref) Task=`e379bca5-9f30-411c-882f-9fc1dc8392e0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:09:52,450::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:09:52,461::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605192 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:09:52,678::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:09:52,689::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599868 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:09:56,274::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [2c2d384f] >Thread-15::DEBUG::2014-08-12 19:09:56,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`b02559ee-b23b-4909-88e9-914d1ad47aa5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:09:56,275::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}], options=None) >Thread-15::DEBUG::2014-08-12 19:09:56,277::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:09:56,278::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:09:56,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,279::__init__::225::IOProcess::(_processLogs) (338) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:09:56,279::__init__::225::IOProcess::(_processLogs) (338) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:09:56,286::__init__::225::IOProcess::(_processLogs) (338) Queuing response >Thread-15::DEBUG::2014-08-12 19:09:56,287::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'68d897e0-6b30-4609-a78d-cdb2c1411233',) >Thread-29::DEBUG::2014-08-12 19:09:56,287::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 19:09:56,287::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain} >Thread-15::INFO::2014-08-12 19:09:56,288::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}]} >Thread-15::DEBUG::2014-08-12 19:09:56,288::task::1191::Storage.TaskManager.Task::(prepare) Task=`b02559ee-b23b-4909-88e9-914d1ad47aa5`::finished: {'statuslist': [{'status': 0, 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}]} >Thread-15::DEBUG::2014-08-12 19:09:56,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`b02559ee-b23b-4909-88e9-914d1ad47aa5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:09:56,289::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:09:56,289::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:09:56,289::task::993::Storage.TaskManager.Task::(_decref) Task=`b02559ee-b23b-4909-88e9-914d1ad47aa5`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:09:56,304::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [2c2d384f] >Thread-15::DEBUG::2014-08-12 19:09:56,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc4518ed-0fca-4025-8ca6-5f7d0f912868`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:09:56,304::logUtils::44::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='68d897e0-6b30-4609-a78d-cdb2c1411233', autoDetach=False, options=None) >Thread-15::DEBUG::2014-08-12 19:09:56,305::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:09:56,305::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:09:56,305::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:09:56,305::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:09:56,327::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:09:56,337::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:09:56,441::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:09:56,459::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.68d897e0-6b30-4609-a78d-cdb2c1411233`ReqID=`4dcb5a69-a7eb-4370-a59b-3302b63ce6b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2741' at 'formatStorageDomain' >Thread-15::DEBUG::2014-08-12 19:09:56,460::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 19:09:56,460::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 19:09:56,460::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.68d897e0-6b30-4609-a78d-cdb2c1411233`ReqID=`4dcb5a69-a7eb-4370-a59b-3302b63ce6b1`::Granted request >Thread-15::DEBUG::2014-08-12 19:09:56,460::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bc4518ed-0fca-4025-8ca6-5f7d0f912868`::_resourcesAcquired: Storage.68d897e0-6b30-4609-a78d-cdb2c1411233 (exclusive) >Thread-15::DEBUG::2014-08-12 19:09:56,461::task::993::Storage.TaskManager.Task::(_decref) Task=`bc4518ed-0fca-4025-8ca6-5f7d0f912868`::ref 1 aborting False >Thread-15::DEBUG::2014-08-12 19:09:56,461::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:09:56,461::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:09:56,461::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:09:56,461::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:09:56,462::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:09:56,462::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:09:56,483::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:09:56,491::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:09:56,531::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:09:56,532::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,532::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,532::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,533::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,533::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,533::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,533::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-29::DEBUG::2014-08-12 19:09:56,535::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:09:56,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,535::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,536::__init__::225::IOProcess::(_processLogs) (339) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:09:56,536::__init__::225::IOProcess::(_processLogs) (339) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:09:56,536::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(339) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,536::__init__::225::IOProcess::(_processLogs) (339) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,537::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 19:09:56,540::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/68d897e0-6b30-4609-a78d-cdb2c1411233 >Thread-29::DEBUG::2014-08-12 19:09:56,540::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,540::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:09:56,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,541::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,541::__init__::225::IOProcess::(_processLogs) (340) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:09:56,541::__init__::225::IOProcess::(_processLogs) (340) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:09:56,542::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(340) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,542::__init__::225::IOProcess::(_processLogs) (340) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,543::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 19:09:56,543::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:09:56,544::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,545::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,545::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:09:56,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,546::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,546::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,546::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,546::__init__::225::IOProcess::(_processLogs) (341) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:09:56,546::__init__::225::IOProcess::(_processLogs) (341) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 19:09:56,553::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(341) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,553::__init__::225::IOProcess::(_processLogs) (341) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,553::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 19:09:56,554::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=68d897e0-6b30-4609-a78d-cdb2c1411233', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=69d0ca1c99d46c3290667030af40f3b4370bbfe0'] >Thread-29::DEBUG::2014-08-12 19:09:56,554::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 19:09:56,556::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,556::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 19:09:56,556::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,557::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,557::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,558::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,558::__init__::225::IOProcess::(_processLogs) (342) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:09:56,558::__init__::225::IOProcess::(_processLogs) (342) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:09:56,558::__init__::225::IOProcess::(_processLogs) (342) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,558::__init__::225::IOProcess::(_processLogs) (342) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,558::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,559::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,559::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 19:09:56,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,559::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,560::__init__::225::IOProcess::(_processLogs) (343) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:09:56,560::__init__::225::IOProcess::(_processLogs) (343) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:09:56,561::__init__::225::IOProcess::(_processLogs) (343) Queuing response >Thread-15::DEBUG::2014-08-12 19:09:56,561::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 19:09:56,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 19:09:56,562::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 68d897e0-6b30-4609-a78d-cdb2c1411233_imageNS already registered >Thread-29::DEBUG::2014-08-12 19:09:56,562::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::INFO::2014-08-12 19:09:56,563::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 68d897e0-6b30-4609-a78d-cdb2c1411233_volumeNS already registered >Thread-29::DEBUG::2014-08-12 19:09:56,564::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:09:56,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,565::__init__::225::IOProcess::(_processLogs) (344) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:09:56,565::__init__::225::IOProcess::(_processLogs) (344) Got request for method 'readfile' >Thread-15::DEBUG::2014-08-12 19:09:56,565::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=68d897e0-6b30-4609-a78d-cdb2c1411233', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=69d0ca1c99d46c3290667030af40f3b4370bbfe0'] >Thread-29::DEBUG::2014-08-12 19:09:56,565::__init__::225::IOProcess::(_processLogs) (344) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 19:09:56,567::fileSD::508::Storage.StorageDomain::(format) Formatting domain 68d897e0-6b30-4609-a78d-cdb2c1411233 >Thread-29::DEBUG::2014-08-12 19:09:56,568::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 19:09:56,569::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:09:56,570::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,570::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,570::__init__::225::IOProcess::(_processLogs) (345) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:09:56,570::__init__::225::IOProcess::(_processLogs) (345) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:09:56,571::__init__::225::IOProcess::(_processLogs) (345) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,573::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,574::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-29::DEBUG::2014-08-12 19:09:56,577::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:09:56,577::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,578::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,578::__init__::225::IOProcess::(_processLogs) (346) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:09:56,578::__init__::225::IOProcess::(_processLogs) (346) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 19:09:56,579::__init__::225::IOProcess::(_processLogs) (346) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,579::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,579::__init__::225::IOProcess::(_processLogs) Sending response sized 101 >Thread-29::DEBUG::2014-08-12 19:09:56,580::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 19:09:56,580::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,580::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,580::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,580::__init__::225::IOProcess::(_processLogs) (347) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:09:56,581::__init__::225::IOProcess::(_processLogs) (347) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:09:56,581::__init__::225::IOProcess::(_processLogs) (347) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,581::__init__::225::IOProcess::(_processLogs) (347) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,581::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,582::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 19:09:56,582::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,582::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,583::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,583::__init__::225::IOProcess::(_processLogs) (348) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:09:56,583::__init__::225::IOProcess::(_processLogs) (348) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 19:09:56,584::__init__::225::IOProcess::(_processLogs) (348) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,584::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,584::__init__::225::IOProcess::(_processLogs) Sending response sized 141 >Thread-29::DEBUG::2014-08-12 19:09:56,585::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 19:09:56,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,586::__init__::225::IOProcess::(_processLogs) (349) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:09:56,586::__init__::225::IOProcess::(_processLogs) (349) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:09:56,586::__init__::225::IOProcess::(_processLogs) (349) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,587::__init__::225::IOProcess::(_processLogs) (349) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,587::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:09:56,587::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-29::DEBUG::2014-08-12 19:09:56,587::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,588::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,588::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,588::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,588::__init__::225::IOProcess::(_processLogs) (350) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:09:56,588::__init__::225::IOProcess::(_processLogs) (350) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:09:56,589::__init__::225::IOProcess::(_processLogs) (350) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,589::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,589::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,590::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:09:56,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,590::__init__::225::IOProcess::(_processLogs) (351) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:09:56,591::__init__::225::IOProcess::(_processLogs) (351) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:09:56,591::__init__::225::IOProcess::(_processLogs) (351) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,592::__init__::225::IOProcess::(_processLogs) Sending response sized 319 >Thread-29::DEBUG::2014-08-12 19:09:56,592::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:09:56,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,592::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,593::__init__::225::IOProcess::(_processLogs) (352) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:09:56,593::__init__::225::IOProcess::(_processLogs) (352) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:09:56,594::__init__::225::IOProcess::(_processLogs) (352) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,594::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,594::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:09:56,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,595::__init__::225::IOProcess::(_processLogs) (353) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:09:56,595::__init__::225::IOProcess::(_processLogs) (353) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:09:56,596::__init__::225::IOProcess::(_processLogs) (353) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,597::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 19:09:56,597::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:09:56,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,598::__init__::225::IOProcess::(_processLogs) (354) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:09:56,598::__init__::225::IOProcess::(_processLogs) (354) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:09:56,598::__init__::225::IOProcess::(_processLogs) (354) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,599::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,599::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 19:09:56,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,600::__init__::225::IOProcess::(_processLogs) (355) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:09:56,600::__init__::225::IOProcess::(_processLogs) (355) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:09:56,601::__init__::225::IOProcess::(_processLogs) (355) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,602::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 19:09:56,602::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 19:09:56,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,603::__init__::225::IOProcess::(_processLogs) (356) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:09:56,603::__init__::225::IOProcess::(_processLogs) (356) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:09:56,603::__init__::225::IOProcess::(_processLogs) (356) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,603::__init__::225::IOProcess::(_processLogs) (356) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,603::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,604::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,604::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,605::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:09:56,605::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,605::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,606::__init__::225::IOProcess::(_processLogs) (357) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:09:56,606::__init__::225::IOProcess::(_processLogs) (357) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:09:56,607::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(357) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,607::__init__::225::IOProcess::(_processLogs) (357) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,607::__init__::225::IOProcess::(_processLogs) Sending response sized 314 >Thread-29::DEBUG::2014-08-12 19:09:56,608::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,608::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-29::DEBUG::2014-08-12 19:09:56,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,608::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,609::__init__::225::IOProcess::(_processLogs) (358) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:09:56,609::__init__::225::IOProcess::(_processLogs) (358) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:09:56,610::__init__::225::IOProcess::(_processLogs) (358) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,610::__init__::225::IOProcess::(_processLogs) (358) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,610::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,610::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,610::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 19:09:56,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,611::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,611::__init__::225::IOProcess::(_processLogs) (359) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:09:56,612::__init__::225::IOProcess::(_processLogs) (359) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 19:09:56,612::__init__::225::IOProcess::(_processLogs) (359) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,612::__init__::225::IOProcess::(_processLogs) (359) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,613::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,613::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,613::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 19:09:56,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,614::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,614::__init__::225::IOProcess::(_processLogs) (360) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:09:56,614::__init__::225::IOProcess::(_processLogs) (360) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:09:56,615::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(360) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,615::__init__::225::IOProcess::(_processLogs) (360) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,616::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,616::__init__::225::IOProcess::(_processLogs) Sending response sized 315 >Thread-29::DEBUG::2014-08-12 19:09:56,616::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,616::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 19:09:56,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,617::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,618::__init__::225::IOProcess::(_processLogs) (361) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:09:56,618::__init__::225::IOProcess::(_processLogs) (361) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 19:09:56,618::__init__::225::IOProcess::(_processLogs) (361) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,618::__init__::225::IOProcess::(_processLogs) (361) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,618::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,618::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:09:56,619::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,620::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 19:09:56,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,620::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,621::__init__::225::IOProcess::(_processLogs) (362) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:09:56,621::__init__::225::IOProcess::(_processLogs) (362) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 19:09:56,621::__init__::225::IOProcess::(_processLogs) (362) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,621::__init__::225::IOProcess::(_processLogs) (362) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,622::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:09:56,622::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:09:56,622::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:09:56,622::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-29::DEBUG::2014-08-12 19:09:56,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:09:56,623::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:09:56,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:09:56,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:09:56,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:09:56,623::__init__::225::IOProcess::(_processLogs) (363) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:09:56,623::__init__::225::IOProcess::(_processLogs) (363) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 19:09:56,624::__init__::225::IOProcess::(_processLogs) (363) Building response >Thread-29::DEBUG::2014-08-12 19:09:56,624::__init__::225::IOProcess::(_processLogs) (363) Queuing response >Thread-29::DEBUG::2014-08-12 19:09:56,624::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Generating json... >Thread-15::INFO::2014-08-12 19:09:56,625::logUtils::47::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-29::DEBUG::2014-08-12 19:09:56,625::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 19:09:56,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc4518ed-0fca-4025-8ca6-5f7d0f912868`::finished: None >Thread-15::DEBUG::2014-08-12 19:09:56,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc4518ed-0fca-4025-8ca6-5f7d0f912868`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:09:56,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233': < ResourceRef 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 19:09:56,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:09:56,627::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' >Thread-15::DEBUG::2014-08-12 19:09:56,627::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' (0 active users) >Thread-15::DEBUG::2014-08-12 19:09:56,627::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:09:56,627::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.68d897e0-6b30-4609-a78d-cdb2c1411233', Clearing records. >Thread-15::DEBUG::2014-08-12 19:09:56,628::task::993::Storage.TaskManager.Task::(_decref) Task=`bc4518ed-0fca-4025-8ca6-5f7d0f912868`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:09:56,699::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [664df58] >Thread-15::DEBUG::2014-08-12 19:09:56,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4aa5e9e-8a34-4c65-a499-75ac0930fc14`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:09:56,700::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}], options=None) >Thread-15::DEBUG::2014-08-12 19:09:56,700::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 19:09:56,756::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:09:56,757::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:09:56,757::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:09:56,757::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:09:56,757::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:09:56,758::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:09:56,778::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:09:56,780::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:09:56,832::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:09:56,832::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,833::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,833::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,833::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,833::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,833::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:09:56,834::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 19:09:56,834::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}]} >Thread-15::DEBUG::2014-08-12 19:09:56,834::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4aa5e9e-8a34-4c65-a499-75ac0930fc14`::finished: {'statuslist': [{'status': 0, 'id': 'ded34489-0327-4729-8587-d0e3beddbfe7'}]} >Thread-15::DEBUG::2014-08-12 19:09:56,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4aa5e9e-8a34-4c65-a499-75ac0930fc14`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:09:56,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:09:56,835::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:09:56,835::task::993::Storage.TaskManager.Task::(_decref) Task=`a4aa5e9e-8a34-4c65-a499-75ac0930fc14`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:09:57,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`82ce366e-7c97-47fb-a25c-d6e752cf30e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:09:57,831::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:09:57,832::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605192', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599868', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:09:57,832::task::1191::Storage.TaskManager.Task::(prepare) Task=`82ce366e-7c97-47fb-a25c-d6e752cf30e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605192', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599868', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:09:57,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`82ce366e-7c97-47fb-a25c-d6e752cf30e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:09:57,832::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:09:57,832::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:09:57,832::task::993::Storage.TaskManager.Task::(_decref) Task=`82ce366e-7c97-47fb-a25c-d6e752cf30e5`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:10:02,306::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [3f2fe5c] >Thread-15::DEBUG::2014-08-12 19:10:02,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6f2bfc7-69fe-4cb6-91fb-5369924d1b53`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:10:02,308::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) >Thread-15::DEBUG::2014-08-12 19:10:02,309::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 19:10:02,310::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=7,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-16::DEBUG::2014-08-12 19:10:02,465::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:10:02,468::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:10:02,704::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-17::DEBUG::2014-08-12 19:10:02,705::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:10:02,745::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:10:02,746::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:10:02,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611426 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:10:02,891::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:10:02,891::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:10:02,891::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:10:02,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061084 s, 6.7 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:10:07,369::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:07,376::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 19:10:07,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:07,376::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:07,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:07,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:07,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:07,377::__init__::225::IOProcess::(_processLogs) (364) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:10:07,378::__init__::225::IOProcess::(_processLogs) (364) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:10:07,378::__init__::225::IOProcess::(_processLogs) (364) Building response >Thread-29::DEBUG::2014-08-12 19:10:07,378::__init__::225::IOProcess::(_processLogs) (364) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:07,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:07,379::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 19:10:07,390::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:10:07,390::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:07,390::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:10:07,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:07,391::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:07,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:07,391::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:07,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:07,391::__init__::225::IOProcess::(_processLogs) (365) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:10:07,392::__init__::225::IOProcess::(_processLogs) (365) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 19:10:07,392::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-29::DEBUG::2014-08-12 19:10:07,392::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(365) Building response >Thread-15::DEBUG::2014-08-12 19:10:07,393::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain} >Thread-15::INFO::2014-08-12 19:10:07,394::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-29::DEBUG::2014-08-12 19:10:07,394::__init__::225::IOProcess::(_processLogs) (365) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:07,395::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6f2bfc7-69fe-4cb6-91fb-5369924d1b53`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-08-12 19:10:07,396::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6f2bfc7-69fe-4cb6-91fb-5369924d1b53`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 19:10:07,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:10:07,396::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:10:07,397::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-08-12 19:10:07,397::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:10:07,398::task::993::Storage.TaskManager.Task::(_decref) Task=`e6f2bfc7-69fe-4cb6-91fb-5369924d1b53`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:10:07,441::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 19:10:07,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`51df6f60-e574-4aa3-ac68-3243afe4e0e7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:10:07,442::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', options=None) >Thread-15::DEBUG::2014-08-12 19:10:07,442::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:10:07,442::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:10:07,443::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:10:07,443::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:10:07,443::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:10:07,443::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:10:07,473::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:10:07,475::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:10:07,575::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:10:07,575::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,575::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,576::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,576::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,576::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,576::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,577::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:10:07,577::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,580::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-15::DEBUG::2014-08-12 19:10:07,791::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:10:07,792::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-29::DEBUG::2014-08-12 19:10:07,794::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:07,794::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:10:07,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:07,794::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:07,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:07,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:07,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:07,795::__init__::225::IOProcess::(_processLogs) (366) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:10:07,795::__init__::225::IOProcess::(_processLogs) (366) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:10:07,795::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(366) Building response >Thread-29::DEBUG::2014-08-12 19:10:07,796::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(366) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:07,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 19:10:07,798::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-29::DEBUG::2014-08-12 19:10:07,799::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:10:07,799::task::1191::Storage.TaskManager.Task::(prepare) Task=`51df6f60-e574-4aa3-ac68-3243afe4e0e7`::finished: {'domlist': []} >Thread-15::DEBUG::2014-08-12 19:10:07,801::task::595::Storage.TaskManager.Task::(_updateState) Task=`51df6f60-e574-4aa3-ac68-3243afe4e0e7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:10:07,801::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:10:07,801::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:10:07,801::task::993::Storage.TaskManager.Task::(_decref) Task=`51df6f60-e574-4aa3-ac68-3243afe4e0e7`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:10:07,877::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [58f8d6c1] >Thread-15::DEBUG::2014-08-12 19:10:07,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eb86dce-386e-4e2e-a8f4-ec2326dab4c7`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:10:07,878::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}], options=None) >Thread-15::DEBUG::2014-08-12 19:10:07,880::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:10:07,881::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:07,881::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:10:07,881::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:07,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:07,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:07,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:07,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:07,882::__init__::225::IOProcess::(_processLogs) (367) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:10:07,882::__init__::225::IOProcess::(_processLogs) (367) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:10:07,882::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(367) Building response >Thread-15::DEBUG::2014-08-12 19:10:07,883::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-29::DEBUG::2014-08-12 19:10:07,883::__init__::225::IOProcess::(_processLogs) (367) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:07,884::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain} >Thread-29::DEBUG::2014-08-12 19:10:07,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 19:10:07,885::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}]} >Thread-15::DEBUG::2014-08-12 19:10:07,885::task::1191::Storage.TaskManager.Task::(prepare) Task=`3eb86dce-386e-4e2e-a8f4-ec2326dab4c7`::finished: {'statuslist': [{'status': 0, 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}]} >Thread-29::DEBUG::2014-08-12 19:10:07,885::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:10:07,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eb86dce-386e-4e2e-a8f4-ec2326dab4c7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:10:07,886::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:10:07,886::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:10:07,887::task::993::Storage.TaskManager.Task::(_decref) Task=`3eb86dce-386e-4e2e-a8f4-ec2326dab4c7`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:10:07,909::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [58f8d6c1] >Thread-15::DEBUG::2014-08-12 19:10:07,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`e14eb143-3483-4185-82f2-594b4edd2a64`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:10:07,910::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='b6cdb3e0-8d34-4a62-b549-b76d054a4386', domainName='pNFS', typeSpecificArg='netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', domClass=1, domVersion='3', options=None) >Thread-15::DEBUG::2014-08-12 19:10:07,910::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:10:07,910::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:10:07,910::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:10:07,911::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:10:07,911::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:10:07,911::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:10:07,932::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:10:07,940::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:10:07,991::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:10:07,991::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,992::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,992::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,992::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,992::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,993::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,993::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::ERROR::2014-08-12 19:10:07,993::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain b6cdb3e0-8d34-4a62-b549-b76d054a4386 >Thread-15::ERROR::2014-08-12 19:10:07,993::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain b6cdb3e0-8d34-4a62-b549-b76d054a4386 >Thread-15::DEBUG::2014-08-12 19:10:07,993::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:10:07,996::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b6cdb3e0-8d34-4a62-b549-b76d054a4386 (cwd None) >Thread-15::DEBUG::2014-08-12 19:10:08,187::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "b6cdb3e0-8d34-4a62-b549-b76d054a4386" not found\n Skipping volume group b6cdb3e0-8d34-4a62-b549-b76d054a4386\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 19:10:08,190::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "b6cdb3e0-8d34-4a62-b549-b76d054a4386" not found', ' Skipping volume group b6cdb3e0-8d34-4a62-b549-b76d054a4386'] >Thread-15::DEBUG::2014-08-12 19:10:08,190::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-29::DEBUG::2014-08-12 19:10:08,192::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,192::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:10:08,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,192::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,193::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,193::__init__::225::IOProcess::(_processLogs) (368) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:10:08,193::__init__::225::IOProcess::(_processLogs) (368) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:10:08,194::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(368) Building response >Thread-15::ERROR::2014-08-12 19:10:08,195::sdc::143::Storage.StorageDomainCache::(_findDomain) domain b6cdb3e0-8d34-4a62-b549-b76d054a4386 not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('b6cdb3e0-8d34-4a62-b549-b76d054a4386',) >Thread-29::DEBUG::2014-08-12 19:10:08,195::__init__::225::IOProcess::(_processLogs) (368) Queuing response >Thread-15::INFO::2014-08-12 19:10:08,196::nfsSD::69::Storage.StorageDomain::(create) sdUUID=b6cdb3e0-8d34-4a62-b549-b76d054a4386 domainName=pNFS remotePath=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 domClass=1 >Thread-29::DEBUG::2014-08-12 19:10:08,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,198::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:10:08,201::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,202::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 19:10:08,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,202::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,203::__init__::225::IOProcess::(_processLogs) (369) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:10:08,203::__init__::225::IOProcess::(_processLogs) (369) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:10:08,203::__init__::225::IOProcess::(_processLogs) (369) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,203::__init__::225::IOProcess::(_processLogs) (369) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,204::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,208::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,209::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:10:08,209::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,209::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,210::__init__::225::IOProcess::(_processLogs) (370) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:10:08,210::__init__::225::IOProcess::(_processLogs) (370) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:10:08,210::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(370) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,210::__init__::225::IOProcess::(_processLogs) (370) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,211::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,211::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,212::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,212::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-29::DEBUG::2014-08-12 19:10:08,212::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,213::__init__::225::IOProcess::(_processLogs) (371) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:10:08,213::__init__::225::IOProcess::(_processLogs) (371) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:10:08,213::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|(371) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,214::__init__::225::IOProcess::(_processLogs) (371) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,214::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:10:08,215::__init__::225::IOProcess::(_processLogs) Sending response sized 73DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,215::__init__::225::IOProcess::(_processLogs) Message size is 70 >Thread-29::DEBUG::2014-08-12 19:10:08,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,216::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,216::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,217::__init__::225::IOProcess::(_processLogs) (372) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,217::__init__::225::IOProcess::(_processLogs) (372) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,217::__init__::225::IOProcess::(_processLogs) (372) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,217::__init__::225::IOProcess::(_processLogs) (372) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,217::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,217::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,218::__init__::225::IOProcess::(_processLogs) Message size is 74 >Thread-29::DEBUG::2014-08-12 19:10:08,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,219::__init__::225::IOProcess::(_processLogs) (373) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,219::__init__::225::IOProcess::(_processLogs) (373) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,219::__init__::225::IOProcess::(_processLogs) (373) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,220::__init__::225::IOProcess::(_processLogs) (373) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,220::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,220::__init__::225::IOProcess::(_processLogs) Message size is 86 >Thread-29::DEBUG::2014-08-12 19:10:08,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,222::__init__::225::IOProcess::(_processLogs) (374) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,222::__init__::225::IOProcess::(_processLogs) (374) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,222::__init__::225::IOProcess::(_processLogs) (374) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,222::__init__::225::IOProcess::(_processLogs) (374) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,222::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,222::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,223::__init__::225::IOProcess::(_processLogs) Message size is 90 >Thread-29::DEBUG::2014-08-12 19:10:08,223::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,224::__init__::225::IOProcess::(_processLogs) (375) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,224::__init__::225::IOProcess::(_processLogs) (375) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,224::__init__::225::IOProcess::(_processLogs) (375) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,225::__init__::225::IOProcess::(_processLogs) (375) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,225::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,225::__init__::225::IOProcess::(_processLogs) Message size is 143 >Thread-29::DEBUG::2014-08-12 19:10:08,225::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,227::__init__::225::IOProcess::(_processLogs) (376) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,227::__init__::225::IOProcess::(_processLogs) (376) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,227::__init__::225::IOProcess::(_processLogs) (376) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,227::__init__::225::IOProcess::(_processLogs) (376) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,227::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,228::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:10:08,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,229::__init__::225::IOProcess::(_processLogs) (377) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,229::__init__::225::IOProcess::(_processLogs) (377) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,231::__init__::225::IOProcess::(_processLogs) (377) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,231::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,232::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 19:10:08,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,233::__init__::225::IOProcess::(_processLogs) (378) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,233::__init__::225::IOProcess::(_processLogs) (378) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,235::__init__::225::IOProcess::(_processLogs) (378) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,236::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,236::__init__::225::IOProcess::(_processLogs) Message size is 229 >Thread-29::DEBUG::2014-08-12 19:10:08,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,237::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,237::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,237::__init__::225::IOProcess::(_processLogs) (379) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 19:10:08,237::__init__::225::IOProcess::(_processLogs) (379) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 19:10:08,240::__init__::225::IOProcess::(_processLogs) (379) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,241::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,241::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-29::DEBUG::2014-08-12 19:10:08,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,242::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,242::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,242::__init__::225::IOProcess::(_processLogs) (380) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 19:10:08,242::__init__::225::IOProcess::(_processLogs) (380) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 19:10:08,243::__init__::225::IOProcess::(_processLogs) (380) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,244::__init__::225::IOProcess::(_processLogs) Message size is 230 >Thread-29::DEBUG::2014-08-12 19:10:08,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,244::__init__::225::IOProcess::(_processLogs) (381) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 19:10:08,245::__init__::225::IOProcess::(_processLogs) (381) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 19:10:08,247::__init__::225::IOProcess::(_processLogs) (381) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,248::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,248::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 19:10:08,248::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,249::__init__::225::IOProcess::(_processLogs) (382) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 19:10:08,249::__init__::225::IOProcess::(_processLogs) (382) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 19:10:08,251::__init__::225::IOProcess::(_processLogs) (382) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,252::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,252::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,252::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-29::DEBUG::2014-08-12 19:10:08,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,252::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,253::__init__::225::IOProcess::(_processLogs) (383) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 19:10:08,253::__init__::225::IOProcess::(_processLogs) (383) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 19:10:08,255::__init__::225::IOProcess::(_processLogs) DEBUG|(383) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,256::__init__::225::IOProcess::(_processLogs) (383) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,256::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,256::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,256::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 19:10:08,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,257::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,257::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,257::__init__::225::IOProcess::(_processLogs) (384) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 19:10:08,257::__init__::225::IOProcess::(_processLogs) (384) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 19:10:08,258::__init__::225::IOProcess::(_processLogs) (384) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,259::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,259::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,260::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-29::DEBUG::2014-08-12 19:10:08,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,260::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,261::__init__::225::IOProcess::(_processLogs) (385) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 19:10:08,261::__init__::225::IOProcess::(_processLogs) (385) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 19:10:08,261::__init__::225::IOProcess::(_processLogs) DEBUG|(385) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,262::__init__::225::IOProcess::(_processLogs) (385) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,262::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,262::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,262::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-29::DEBUG::2014-08-12 19:10:08,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,263::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,263::__init__::225::IOProcess::(_processLogs) (386) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 19:10:08,264::__init__::225::IOProcess::(_processLogs) (386) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 19:10:08,264::__init__::225::IOProcess::(_processLogs) DEBUG|(386) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,265::__init__::225::IOProcess::(_processLogs) (386) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:08,265::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:10:08,265::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,266::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,267::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,267::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:10:08,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,267::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,268::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,268::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,268::__init__::225::IOProcess::(_processLogs) (387) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:10:08,268::__init__::225::IOProcess::(_processLogs) (387) Got request for method 'readfile' >Thread-15::DEBUG::2014-08-12 19:10:08,269::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-29::DEBUG::2014-08-12 19:10:08,269::__init__::225::IOProcess::(_processLogs) DEBUG|(387) Building response >Thread-15::DEBUG::2014-08-12 19:10:08,269::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 19:10:08,270::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-29::DEBUG::2014-08-12 19:10:08,270::__init__::225::IOProcess::(_processLogs) (387) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:08,270::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-29::DEBUG::2014-08-12 19:10:08,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:10:08,271::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=b6cdb3e0-8d34-4a62-b549-b76d054a4386', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=760da0ce03c4d6e3fb8aeba5fd8a57dafa5791cc'] >Thread-29::DEBUG::2014-08-12 19:10:08,271::__init__::225::IOProcess::(_processLogs) Sending response sized 93 >Thread-29::DEBUG::2014-08-12 19:10:08,272::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,272::__init__::225::IOProcess::(_processLogs) Message size is 644 >Thread-29::DEBUG::2014-08-12 19:10:08,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,273::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,273::__init__::225::IOProcess::(_processLogs) (388) Finding callback 'writefile'... >Thread-29::DEBUG::2014-08-12 19:10:08,273::__init__::225::IOProcess::(_processLogs) (388) Got request for method 'writefile' >Thread-29::DEBUG::2014-08-12 19:10:08,275::__init__::225::IOProcess::(_processLogs) DEBUG|(388) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,276::__init__::225::IOProcess::(_processLogs) (388) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,276::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,277::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::WARNING::2014-08-12 19:10:08,276::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-29::DEBUG::2014-08-12 19:10:08,278::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,278::__init__::225::IOProcess::(_processLogs) Message size is 333 >Thread-29::DEBUG::2014-08-12 19:10:08,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,278::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,279::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,279::__init__::225::IOProcess::(_processLogs) (389) Finding callback 'rename'... >Thread-29::DEBUG::2014-08-12 19:10:08,279::__init__::225::IOProcess::(_processLogs) (389) Got request for method 'rename' >Thread-29::DEBUG::2014-08-12 19:10:08,280::__init__::225::IOProcess::(_processLogs) DEBUG|(389) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,280::__init__::225::IOProcess::(_processLogs) (389) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:08,281::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-29::DEBUG::2014-08-12 19:10:08,281::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,281::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,282::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,282::__init__::225::IOProcess::(_processLogs) Message size is 70 >Thread-29::DEBUG::2014-08-12 19:10:08,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,283::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,283::__init__::225::IOProcess::(_processLogs) (390) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,284::__init__::225::IOProcess::(_processLogs) (390) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,284::__init__::225::IOProcess::(_processLogs) (390) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,284::__init__::225::IOProcess::(_processLogs) (390) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,284::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,285::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,285::__init__::225::IOProcess::(_processLogs) Message size is 74 >Thread-29::DEBUG::2014-08-12 19:10:08,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,286::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,286::__init__::225::IOProcess::(_processLogs) (391) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,287::__init__::225::IOProcess::(_processLogs) (391) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,287::__init__::225::IOProcess::(_processLogs) (391) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,287::__init__::225::IOProcess::(_processLogs) (391) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,287::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,287::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,288::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,288::__init__::225::IOProcess::(_processLogs) Message size is 86 >Thread-29::DEBUG::2014-08-12 19:10:08,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,289::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,289::__init__::225::IOProcess::(_processLogs) (392) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,290::__init__::225::IOProcess::(_processLogs) (392) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,290::__init__::225::IOProcess::(_processLogs) (392) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,290::__init__::225::IOProcess::(_processLogs) (392) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,290::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,290::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,291::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,291::__init__::225::IOProcess::(_processLogs) Message size is 90 >Thread-29::DEBUG::2014-08-12 19:10:08,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,292::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,292::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,292::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,293::__init__::225::IOProcess::(_processLogs) (393) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,293::__init__::225::IOProcess::(_processLogs) (393) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,293::__init__::225::IOProcess::(_processLogs) (393) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,293::__init__::225::IOProcess::(_processLogs) (393) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,294::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,294::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,294::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,294::__init__::225::IOProcess::(_processLogs) Message size is 143 >Thread-29::DEBUG::2014-08-12 19:10:08,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,295::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,295::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,295::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,296::__init__::225::IOProcess::(_processLogs) (394) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,296::__init__::225::IOProcess::(_processLogs) (394) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,296::__init__::225::IOProcess::(_processLogs) (394) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,296::__init__::225::IOProcess::(_processLogs) (394) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,297::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,297::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,297::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:10:08,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,298::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,299::__init__::225::IOProcess::(_processLogs) (395) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,299::__init__::225::IOProcess::(_processLogs) (395) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:10:08,299::__init__::225::IOProcess::(_processLogs) DEBUG|(395) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,300::__init__::225::IOProcess::(_processLogs) (395) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,300::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,300::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:10:08,300::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,300::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 19:10:08,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,301::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,301::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,302::__init__::225::IOProcess::(_processLogs) (396) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:10:08,302::__init__::225::IOProcess::(_processLogs) (396) Got request for method 'mkdir' >Thread-15::DEBUG::2014-08-12 19:10:08,302::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/b6cdb3e0-8d34-4a62-b549-b76d054a4386 >Thread-29::DEBUG::2014-08-12 19:10:08,302::__init__::225::IOProcess::(_processLogs) DEBUG|(396) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,303::__init__::225::IOProcess::(_processLogs) (396) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,303::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,304::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,304::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:10:08,304::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,304::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,305::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,305::__init__::225::IOProcess::(_processLogs) (397) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:10:08,305::__init__::225::IOProcess::(_processLogs) (397) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:10:08,306::__init__::225::IOProcess::(_processLogs) DEBUG|(397) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,306::__init__::225::IOProcess::(_processLogs) (397) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:08,307::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:10:08,307::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,308::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,308::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,308::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:10:08,308::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,309::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,309::__init__::225::IOProcess::(_processLogs) (398) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:10:08,309::__init__::225::IOProcess::(_processLogs) (398) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 19:10:08,310::__init__::225::IOProcess::(_processLogs) DEBUG|(398) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,311::__init__::225::IOProcess::(_processLogs) (398) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:08,311::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=b6cdb3e0-8d34-4a62-b549-b76d054a4386', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=760da0ce03c4d6e3fb8aeba5fd8a57dafa5791cc'] >Thread-29::DEBUG::2014-08-12 19:10:08,312::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,313::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 19:10:08,314::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,314::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 19:10:08,314::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,314::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,315::__init__::225::IOProcess::(_processLogs) (399) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:10:08,315::__init__::225::IOProcess::(_processLogs) (399) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:10:08,316::__init__::225::IOProcess::(_processLogs) DEBUG|(399) Building response >Thread-29::DEBUG::2014-08-12 19:10:08,316::__init__::225::IOProcess::(_processLogs) (399) Queuing response >Thread-29::DEBUG::2014-08-12 19:10:08,316::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,316::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:10:08,317::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:10:08,317::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 19:10:08,317::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,317::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,317::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:10:08,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,318::__init__::225::IOProcess::(_processLogs) (400) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:10:08,318::__init__::225::IOProcess::(_processLogs) (400) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:10:08,320::__init__::225::IOProcess::(_processLogs) DEBUG|(400) Building response >Thread-15::DEBUG::2014-08-12 19:10:08,320::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 19:10:08,320::__init__::225::IOProcess::(_processLogs) (400) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:08,321::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'b6cdb3e0-8d34-4a62-b549-b76d054a4386_imageNS' >Thread-29::DEBUG::2014-08-12 19:10:08,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:10:08,322::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:10:08,323::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'b6cdb3e0-8d34-4a62-b549-b76d054a4386_volumeNS' >Thread-15::DEBUG::2014-08-12 19:10:08,323::clusterlock::143::Storage.initSANLock::(initSANLock) Initializing SANLock for domain b6cdb3e0-8d34-4a62-b549-b76d054a4386 >Thread-15::DEBUG::2014-08-12 19:10:08,469::sd::443::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-15::DEBUG::2014-08-12 19:10:08,469::hsm::2685::Storage.HSM::(createStorageDomain) knownSDs: {0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, b6cdb3e0-8d34-4a62-b549-b76d054a4386: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 19:10:08,469::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-15::DEBUG::2014-08-12 19:10:08,470::task::1191::Storage.TaskManager.Task::(prepare) Task=`e14eb143-3483-4185-82f2-594b4edd2a64`::finished: None >Thread-15::DEBUG::2014-08-12 19:10:08,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`e14eb143-3483-4185-82f2-594b4edd2a64`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:10:08,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:10:08,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:10:08,470::task::993::Storage.TaskManager.Task::(_decref) Task=`e14eb143-3483-4185-82f2-594b4edd2a64`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:10:08,526::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [58f8d6c1] >Thread-15::DEBUG::2014-08-12 19:10:08,527::task::595::Storage.TaskManager.Task::(_updateState) Task=`77976acd-0452-42e9-a637-c8e7cdc80812`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:10:08,527::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='b6cdb3e0-8d34-4a62-b549-b76d054a4386', options=None) >Thread-15::DEBUG::2014-08-12 19:10:08,527::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386`ReqID=`746ce9b9-161d-481e-b669-8ac291b58f0d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2824' at 'getStorageDomainStats' >Thread-15::DEBUG::2014-08-12 19:10:08,527::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 19:10:08,528::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 19:10:08,528::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386`ReqID=`746ce9b9-161d-481e-b669-8ac291b58f0d`::Granted request >Thread-15::DEBUG::2014-08-12 19:10:08,528::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`77976acd-0452-42e9-a637-c8e7cdc80812`::_resourcesAcquired: Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386 (shared) >Thread-15::DEBUG::2014-08-12 19:10:08,528::task::993::Storage.TaskManager.Task::(_decref) Task=`77976acd-0452-42e9-a637-c8e7cdc80812`::ref 1 aborting False >Thread-29::DEBUG::2014-08-12 19:10:08,529::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:10:08,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:10:08,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:10:08,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:10:08,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:10:08,530::__init__::225::IOProcess::(_processLogs) (401) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:10:08,530::__init__::225::IOProcess::(_processLogs) (401) Got request for method 'statvfs' >Thread-15::INFO::2014-08-12 19:10:08,531::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21472411648', 'disktotal': '21474836480', 'mdafree': 0}} >Thread-29::DEBUG::2014-08-12 19:10:08,531::__init__::225::IOProcess::(_processLogs) (401) Queuing response >Thread-15::DEBUG::2014-08-12 19:10:08,531::task::1191::Storage.TaskManager.Task::(prepare) Task=`77976acd-0452-42e9-a637-c8e7cdc80812`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21472411648', 'disktotal': '21474836480', 'mdafree': 0}} >Thread-15::DEBUG::2014-08-12 19:10:08,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`77976acd-0452-42e9-a637-c8e7cdc80812`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 19:10:08,532::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:10:08,532::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386': < ResourceRef 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 19:10:08,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-08-12 19:10:08,533::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 19:10:08,534::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' >Thread-15::DEBUG::2014-08-12 19:10:08,534::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' (0 active users) >Thread-15::DEBUG::2014-08-12 19:10:08,534::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:10:08,534::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386', Clearing records. >Thread-15::DEBUG::2014-08-12 19:10:08,535::task::993::Storage.TaskManager.Task::(_decref) Task=`77976acd-0452-42e9-a637-c8e7cdc80812`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:10:12,759::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:10:12,759::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:10:12,903::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-17::DEBUG::2014-08-12 19:10:12,904::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 19:10:12,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`33070f2d-e786-4e0e-8a6c-53952a8a7a66`::moving from state init -> state preparing >Thread-16::DEBUG::2014-08-12 19:10:12,951::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::INFO::2014-08-12 19:10:12,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-16::DEBUG::2014-08-12 19:10:12,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-15::INFO::2014-08-12 19:10:12,954::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611426', 'lastCheck': '10.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061084', 'lastCheck': '10.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:10:12,964::task::1191::Storage.TaskManager.Task::(prepare) Task=`33070f2d-e786-4e0e-8a6c-53952a8a7a66`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611426', 'lastCheck': '10.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061084', 'lastCheck': '10.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:10:12,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`33070f2d-e786-4e0e-8a6c-53952a8a7a66`::moving from state preparing -> state finished >Thread-16::DEBUG::2014-08-12 19:10:12,965::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000541365 s, 7.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:10:12,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:10:12,968::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:10:12,968::task::993::Storage.TaskManager.Task::(_decref) Task=`33070f2d-e786-4e0e-8a6c-53952a8a7a66`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:10:13,081::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:10:13,082::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:10:13,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:10:13,091::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677058 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:10:22,973::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:10:22,984::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063752 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:10:23,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:10:23,110::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000857707 s, 4.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:10:28,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e513aa6-6f1e-4113-8ed1-2084cddc8a0d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:10:28,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:10:28,079::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063752', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000857707', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:10:28,079::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e513aa6-6f1e-4113-8ed1-2084cddc8a0d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063752', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000857707', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:10:28,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e513aa6-6f1e-4113-8ed1-2084cddc8a0d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:10:28,079::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:10:28,079::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:10:28,080::task::993::Storage.TaskManager.Task::(_decref) Task=`0e513aa6-6f1e-4113-8ed1-2084cddc8a0d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:10:32,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:10:32,996::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669418 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:10:33,123::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:10:33,132::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627649 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:10:42,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:10:43,006::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655234 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:10:43,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:10:43,143::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678733 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:10:43,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`10d11e85-cc8a-442e-91bf-b5e68d219cd6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:10:43,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:10:43,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655234', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678733', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:10:43,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`10d11e85-cc8a-442e-91bf-b5e68d219cd6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655234', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000678733', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:10:43,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`10d11e85-cc8a-442e-91bf-b5e68d219cd6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:10:43,198::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:10:43,198::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:10:43,198::task::993::Storage.TaskManager.Task::(_decref) Task=`10d11e85-cc8a-442e-91bf-b5e68d219cd6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:10:53,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:10:53,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664982 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:10:53,146::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:10:53,157::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695799 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:10:58,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`440159cc-43e9-40db-8533-904c3e35cc86`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:10:58,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:10:58,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664982', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695799', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:10:58,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`440159cc-43e9-40db-8533-904c3e35cc86`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664982', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695799', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:10:58,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`440159cc-43e9-40db-8533-904c3e35cc86`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:10:58,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:10:58,313::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:10:58,313::task::993::Storage.TaskManager.Task::(_decref) Task=`440159cc-43e9-40db-8533-904c3e35cc86`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:11:03,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:11:03,031::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774214 s, 5.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:03,036::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [50842305] >Thread-15::DEBUG::2014-08-12 19:11:03,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`01777ee5-87ee-4641-94e2-d1004eee925a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:11:03,047::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}], options=None) >Thread-15::DEBUG::2014-08-12 19:11:03,049::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:11:03,050::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:11:03,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,050::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:11:03,051::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,051::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,051::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,051::__init__::225::IOProcess::(_processLogs) (402) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:11:03,051::__init__::225::IOProcess::(_processLogs) (402) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:11:03,052::__init__::225::IOProcess::(_processLogs) (402) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,052::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,052::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 19:11:03,053::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'b6cdb3e0-8d34-4a62-b549-b76d054a4386',) >Thread-15::DEBUG::2014-08-12 19:11:03,053::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, b6cdb3e0-8d34-4a62-b549-b76d054a4386: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 19:11:03,053::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}]} >Thread-15::DEBUG::2014-08-12 19:11:03,053::task::1191::Storage.TaskManager.Task::(prepare) Task=`01777ee5-87ee-4641-94e2-d1004eee925a`::finished: {'statuslist': [{'status': 0, 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}]} >Thread-15::DEBUG::2014-08-12 19:11:03,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`01777ee5-87ee-4641-94e2-d1004eee925a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:11:03,054::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:11:03,054::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:11:03,054::task::993::Storage.TaskManager.Task::(_decref) Task=`01777ee5-87ee-4641-94e2-d1004eee925a`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:11:03,072::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [50842305] >Thread-15::DEBUG::2014-08-12 19:11:03,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`3982f8b0-f191-4ffa-8d66-b0f05fa044d2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:11:03,073::logUtils::44::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='b6cdb3e0-8d34-4a62-b549-b76d054a4386', autoDetach=False, options=None) >Thread-15::DEBUG::2014-08-12 19:11:03,073::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:11:03,073::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:11:03,073::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:11:03,073::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:11:03,098::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:11:03,100::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-08-12 19:11:03,170::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 19:11:03,170::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:03,180::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386`ReqID=`d1d657b6-3812-45a0-9636-a02d98d25b3d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2741' at 'formatStorageDomain' >Thread-15::DEBUG::2014-08-12 19:11:03,180::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' for lock type 'exclusive' >Thread-17::DEBUG::2014-08-12 19:11:03,181::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579727 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:03,182::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 19:11:03,183::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386`ReqID=`d1d657b6-3812-45a0-9636-a02d98d25b3d`::Granted request >Thread-15::DEBUG::2014-08-12 19:11:03,185::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3982f8b0-f191-4ffa-8d66-b0f05fa044d2`::_resourcesAcquired: Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386 (exclusive) >Thread-15::DEBUG::2014-08-12 19:11:03,186::task::993::Storage.TaskManager.Task::(_decref) Task=`3982f8b0-f191-4ffa-8d66-b0f05fa044d2`::ref 1 aborting False >Thread-15::DEBUG::2014-08-12 19:11:03,187::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:11:03,188::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:11:03,189::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:11:03,190::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:11:03,192::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:11:03,192::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:11:03,213::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:11:03,214::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:11:03,260::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:03,260::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,260::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,261::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,261::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,261::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,261::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,261::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-29::DEBUG::2014-08-12 19:11:03,263::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:11:03,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,264::__init__::225::IOProcess::(_processLogs) (403) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:11:03,264::__init__::225::IOProcess::(_processLogs) (403) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:11:03,264::__init__::225::IOProcess::(_processLogs) (403) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,267::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 19:11:03,269::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/b6cdb3e0-8d34-4a62-b549-b76d054a4386 >Thread-29::DEBUG::2014-08-12 19:11:03,270::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:11:03,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,271::__init__::225::IOProcess::(_processLogs) (404) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:11:03,271::__init__::225::IOProcess::(_processLogs) (404) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:11:03,273::__init__::225::IOProcess::(_processLogs) (404) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:11:03,274::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:11:03,275::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:11:03,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,275::__init__::225::IOProcess::(_processLogs) (405) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:11:03,276::__init__::225::IOProcess::(_processLogs) (405) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 19:11:03,280::__init__::225::IOProcess::(_processLogs) (405) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,280::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-15::DEBUG::2014-08-12 19:11:03,281::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=b6cdb3e0-8d34-4a62-b549-b76d054a4386', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=760da0ce03c4d6e3fb8aeba5fd8a57dafa5791cc'] >Thread-29::DEBUG::2014-08-12 19:11:03,282::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 19:11:03,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,283::__init__::225::IOProcess::(_processLogs) (406) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:11:03,283::__init__::225::IOProcess::(_processLogs) (406) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:11:03,283::__init__::225::IOProcess::(_processLogs) (406) Building response >Thread-29::DEBUG::2014-08-12 19:11:03,284::__init__::225::IOProcess::(_processLogs) (406) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,284::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:11:03,284::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 19:11:03,284::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:11:03,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,285::__init__::225::IOProcess::(_processLogs) (407) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:11:03,285::__init__::225::IOProcess::(_processLogs) (407) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:11:03,285::__init__::225::IOProcess::(_processLogs) (407) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,286::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:11:03,286::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-15::INFO::2014-08-12 19:11:03,287::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b6cdb3e0-8d34-4a62-b549-b76d054a4386_imageNS already registered >Thread-15::INFO::2014-08-12 19:11:03,287::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b6cdb3e0-8d34-4a62-b549-b76d054a4386_volumeNS already registered >Thread-29::DEBUG::2014-08-12 19:11:03,287::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:11:03,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,288::__init__::225::IOProcess::(_processLogs) (408) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:11:03,288::__init__::225::IOProcess::(_processLogs) (408) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 19:11:03,290::__init__::225::IOProcess::(_processLogs) (408) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,290::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-15::DEBUG::2014-08-12 19:11:03,290::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=b6cdb3e0-8d34-4a62-b549-b76d054a4386', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=760da0ce03c4d6e3fb8aeba5fd8a57dafa5791cc'] >Thread-15::INFO::2014-08-12 19:11:03,291::fileSD::508::Storage.StorageDomain::(format) Formatting domain b6cdb3e0-8d34-4a62-b549-b76d054a4386 >Thread-29::DEBUG::2014-08-12 19:11:03,292::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:11:03,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,297::__init__::225::IOProcess::(_processLogs) (409) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:11:03,299::__init__::225::IOProcess::(_processLogs) (409) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:11:03,300::__init__::225::IOProcess::(_processLogs) (409) Building response >Thread-29::DEBUG::2014-08-12 19:11:03,302::__init__::225::IOProcess::(_processLogs) (409) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,305::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-29::DEBUG::2014-08-12 19:11:03,307::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:11:03,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,307::__init__::225::IOProcess::(_processLogs) (410) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:11:03,308::__init__::225::IOProcess::(_processLogs) (410) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 19:11:03,309::__init__::225::IOProcess::(_processLogs) (410) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,309::__init__::225::IOProcess::(_processLogs) Sending response sized 101 >Thread-29::DEBUG::2014-08-12 19:11:03,310::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 19:11:03,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,311::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,311::__init__::225::IOProcess::(_processLogs) (411) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:11:03,312::__init__::225::IOProcess::(_processLogs) (411) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:11:03,312::__init__::225::IOProcess::(_processLogs) (411) Building response >Thread-29::DEBUG::2014-08-12 19:11:03,312::__init__::225::IOProcess::(_processLogs) (411) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,312::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,312::__init__::225::IOProcess::(_processLogs) Sending response sized 314 >Thread-29::DEBUG::2014-08-12 19:11:03,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,313::__init__::225::IOProcess::(_processLogs) (412) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:11:03,315::__init__::225::IOProcess::(_processLogs) (412) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,315::__init__::225::IOProcess::(_processLogs) Sending response sized 141 >Thread-29::DEBUG::2014-08-12 19:11:03,316::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 19:11:03,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,317::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,317::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,317::__init__::225::IOProcess::(_processLogs) (413) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:11:03,317::__init__::225::IOProcess::(_processLogs) (413) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:11:03,318::__init__::225::IOProcess::(_processLogs) (413) Building response >Thread-29::DEBUG::2014-08-12 19:11:03,318::__init__::225::IOProcess::(_processLogs) (413) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,318::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,318::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:11:03,318::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-29::DEBUG::2014-08-12 19:11:03,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,319::__init__::225::IOProcess::(_processLogs) (414) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:11:03,319::__init__::225::IOProcess::(_processLogs) (414) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:11:03,320::__init__::225::IOProcess::(_processLogs) (414) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,321::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:11:03,322::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:11:03,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,322::__init__::225::IOProcess::(_processLogs) (415) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:11:03,323::__init__::225::IOProcess::(_processLogs) (415) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:11:03,325::__init__::225::IOProcess::(_processLogs) (415) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,325::__init__::225::IOProcess::(_processLogs) Sending response sized 319 >Thread-29::DEBUG::2014-08-12 19:11:03,326::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:11:03,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,327::__init__::225::IOProcess::(_processLogs) (416) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:11:03,327::__init__::225::IOProcess::(_processLogs) (416) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:11:03,327::__init__::225::IOProcess::(_processLogs) (416) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,328::__init__::225::IOProcess::(_processLogs) (416) Queuing responseDEBUG|Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:11:03,328::__init__::225::IOProcess::(_processLogs) (416) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:11:03,328::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:11:03,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,329::__init__::225::IOProcess::(_processLogs) (416) Queuing responseDEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:11:03,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,329::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,329::__init__::225::IOProcess::(_processLogs) (417) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:11:03,330::__init__::225::IOProcess::(_processLogs) (417) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:11:03,331::__init__::225::IOProcess::(_processLogs) (416) Queuing responseDEBUG|(417) Building response >Thread-29::DEBUG::2014-08-12 19:11:03,332::__init__::225::IOProcess::(_processLogs) (417) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,332::__init__::225::IOProcess::(_processLogs) (416) Queuing responseDEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,333::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 19:11:03,333::__init__::225::IOProcess::(_processLogs) (416) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:11:03,333::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:11:03,333::__init__::225::IOProcess::(_processLogs) (416) Queuing responseDEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,333::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:11:03,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,334::__init__::225::IOProcess::(_processLogs) (418) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:11:03,334::__init__::225::IOProcess::(_processLogs) (418) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:11:03,335::__init__::225::IOProcess::(_processLogs) (416) Queuing responseDEBUG|(418) Building response >Thread-29::DEBUG::2014-08-12 19:11:03,335::__init__::225::IOProcess::(_processLogs) (418) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,335::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,336::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:11:03,336::__init__::225::IOProcess::(_processLogs) (418) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:11:03,336::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 19:11:03,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,336::__init__::225::IOProcess::(_processLogs) (418) Queuing responseDEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:11:03,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,337::__init__::225::IOProcess::(_processLogs) (419) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:11:03,337::__init__::225::IOProcess::(_processLogs) (419) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:11:03,339::__init__::225::IOProcess::(_processLogs) (418) Queuing responseDEBUG|(419) Building response >Thread-29::DEBUG::2014-08-12 19:11:03,339::__init__::225::IOProcess::(_processLogs) (419) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,339::__init__::225::IOProcess::(_processLogs) (418) Queuing responseDEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,340::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 19:11:03,340::__init__::225::IOProcess::(_processLogs) (418) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:11:03,340::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 19:11:03,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,341::__init__::225::IOProcess::(_processLogs) (418) Queuing responseDEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:11:03,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,341::__init__::225::IOProcess::(_processLogs) (420) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:11:03,341::__init__::225::IOProcess::(_processLogs) (420) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:11:03,342::__init__::225::IOProcess::(_processLogs) (418) Queuing responseDEBUG|(420) Building response >Thread-29::DEBUG::2014-08-12 19:11:03,342::__init__::225::IOProcess::(_processLogs) (420) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,343::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:11:03,343::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:11:03,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,343::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,344::__init__::225::IOProcess::(_processLogs) (421) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:11:03,344::__init__::225::IOProcess::(_processLogs) (421) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:11:03,344::__init__::225::IOProcess::(_processLogs) (421) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,345::__init__::225::IOProcess::(_processLogs) Sending response sized 314 >Thread-29::DEBUG::2014-08-12 19:11:03,346::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-29::DEBUG::2014-08-12 19:11:03,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,346::__init__::225::IOProcess::(_processLogs) (422) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:11:03,347::__init__::225::IOProcess::(_processLogs) (422) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:11:03,347::__init__::225::IOProcess::(_processLogs) (422) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,347::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,347::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:11:03,348::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 19:11:03,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,348::__init__::225::IOProcess::(_processLogs) (423) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:11:03,349::__init__::225::IOProcess::(_processLogs) (423) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 19:11:03,349::__init__::225::IOProcess::(_processLogs) (423) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,349::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:11:03,350::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 19:11:03,350::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,350::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,351::__init__::225::IOProcess::(_processLogs) (424) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:11:03,351::__init__::225::IOProcess::(_processLogs) (424) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:11:03,351::__init__::225::IOProcess::(_processLogs) (424) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,352::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,352::__init__::225::IOProcess::(_processLogs) Sending response sized 315 >Thread-29::DEBUG::2014-08-12 19:11:03,352::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 19:11:03,352::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,353::__init__::225::IOProcess::(_processLogs) (425) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:11:03,353::__init__::225::IOProcess::(_processLogs) (425) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 19:11:03,354::__init__::225::IOProcess::(_processLogs) (425) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,354::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:11:03,354::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 19:11:03,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,355::__init__::225::IOProcess::(_processLogs) (426) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:11:03,355::__init__::225::IOProcess::(_processLogs) (426) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 19:11:03,356::__init__::225::IOProcess::(_processLogs) (426) Queuing response >Thread-29::DEBUG::2014-08-12 19:11:03,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:11:03,356::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:11:03,356::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-29::DEBUG::2014-08-12 19:11:03,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:11:03,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:11:03,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:11:03,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:11:03,357::__init__::225::IOProcess::(_processLogs) (427) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:11:03,357::__init__::225::IOProcess::(_processLogs) (427) Got request for method 'rmdir' >Thread-15::INFO::2014-08-12 19:11:03,358::logUtils::47::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-29::DEBUG::2014-08-12 19:11:03,358::__init__::225::IOProcess::(_processLogs) (427) Queuing response >Thread-15::DEBUG::2014-08-12 19:11:03,358::task::1191::Storage.TaskManager.Task::(prepare) Task=`3982f8b0-f191-4ffa-8d66-b0f05fa044d2`::finished: None >Thread-29::DEBUG::2014-08-12 19:11:03,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:11:03,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`3982f8b0-f191-4ffa-8d66-b0f05fa044d2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:11:03,360::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386': < ResourceRef 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386', isValid: 'True' obj: 'None'>} >Thread-29::DEBUG::2014-08-12 19:11:03,360::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 19:11:03,360::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:11:03,361::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' >Thread-15::DEBUG::2014-08-12 19:11:03,361::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' (0 active users) >Thread-15::DEBUG::2014-08-12 19:11:03,361::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:11:03,361::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b6cdb3e0-8d34-4a62-b549-b76d054a4386', Clearing records. >Thread-15::DEBUG::2014-08-12 19:11:03,361::task::993::Storage.TaskManager.Task::(_decref) Task=`3982f8b0-f191-4ffa-8d66-b0f05fa044d2`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:11:03,464::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [390b559a] >Thread-15::DEBUG::2014-08-12 19:11:03,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`609706cb-b90f-4e55-b8e9-5fc9efb27ff0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:11:03,465::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '7', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}], options=None) >Thread-15::DEBUG::2014-08-12 19:11:03,466::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 19:11:03,511::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:11:03,512::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:11:03,512::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:11:03,512::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:11:03,513::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:11:03,513::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:11:03,540::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:11:03,541::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:11:03,595::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:03,596::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,596::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,596::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,596::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,596::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,597::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:11:03,597::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 19:11:03,597::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}]} >Thread-15::DEBUG::2014-08-12 19:11:03,604::task::1191::Storage.TaskManager.Task::(prepare) Task=`609706cb-b90f-4e55-b8e9-5fc9efb27ff0`::finished: {'statuslist': [{'status': 0, 'id': '8397c631-55eb-41fd-9af1-2b8697576405'}]} >Thread-15::DEBUG::2014-08-12 19:11:03,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`609706cb-b90f-4e55-b8e9-5fc9efb27ff0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:11:03,604::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:11:03,604::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:11:03,604::task::993::Storage.TaskManager.Task::(_decref) Task=`609706cb-b90f-4e55-b8e9-5fc9efb27ff0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:11:13,047::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:11:13,050::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:11:13,201::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-17::DEBUG::2014-08-12 19:11:13,201::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:11:13,416::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:11:13,416::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:11:13,419::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:11:13,419::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:11:13,430::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:11:13,431::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611063 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:11:13,441::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598267 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:13,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`7411b172-b0d0-40ee-8817-ffd8c7516114`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:11:13,464::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:11:13,464::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611063', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598267', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:11:13,464::task::1191::Storage.TaskManager.Task::(prepare) Task=`7411b172-b0d0-40ee-8817-ffd8c7516114`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611063', 'lastCheck': '0.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598267', 'lastCheck': '0.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:11:13,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`7411b172-b0d0-40ee-8817-ffd8c7516114`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:11:13,465::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:11:13,465::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:11:13,465::task::993::Storage.TaskManager.Task::(_decref) Task=`7411b172-b0d0-40ee-8817-ffd8c7516114`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:11:23,442::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:11:23,453::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643045 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:11:23,453::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:11:23,464::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594974 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:28,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`33d179e9-6b5b-451c-a9b2-ba79e7e85d8b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:11:28,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:11:28,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643045', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594974', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:11:28,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`33d179e9-6b5b-451c-a9b2-ba79e7e85d8b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000643045', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594974', 'lastCheck': '5.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:11:28,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`33d179e9-6b5b-451c-a9b2-ba79e7e85d8b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:11:28,578::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:11:28,578::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:11:28,578::task::993::Storage.TaskManager.Task::(_decref) Task=`33d179e9-6b5b-451c-a9b2-ba79e7e85d8b`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:11:33,464::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:11:33,474::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630192 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:11:33,475::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:11:33,496::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0115529 s, 355 kB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:11:43,485::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:11:43,493::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797835 s, 5.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:11:43,499::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:11:43,506::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000808426 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:43,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b7671f4-bc5a-4547-a3a3-0177177a04d5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:11:43,692::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:11:43,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797835', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808426', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:11:43,692::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b7671f4-bc5a-4547-a3a3-0177177a04d5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000797835', 'lastCheck': '0.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808426', 'lastCheck': '0.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:11:43,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b7671f4-bc5a-4547-a3a3-0177177a04d5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:11:43,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:11:43,692::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:11:43,693::task::993::Storage.TaskManager.Task::(_decref) Task=`7b7671f4-bc5a-4547-a3a3-0177177a04d5`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:11:53,495::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:11:53,504::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620626 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:11:53,509::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:11:53,517::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576278 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:11:58,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`99195862-74a1-43bf-9ff9-fd63f0175170`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:11:58,798::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:11:58,798::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620626', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576278', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:11:58,799::task::1191::Storage.TaskManager.Task::(prepare) Task=`99195862-74a1-43bf-9ff9-fd63f0175170`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620626', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576278', 'lastCheck': '5.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:11:58,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`99195862-74a1-43bf-9ff9-fd63f0175170`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:11:58,799::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:11:58,799::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:11:58,799::task::993::Storage.TaskManager.Task::(_decref) Task=`99195862-74a1-43bf-9ff9-fd63f0175170`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:12:03,506::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:12:03,514::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661043 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:12:03,520::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:12:03,529::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065185 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:12:13,516::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:12:13,524::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070827 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:12:13,532::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:12:13,539::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639012 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:12:13,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`78f56b62-a86a-4779-9a9b-1c010c89f498`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:12:13,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:12:13,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070827', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639012', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:12:13,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`78f56b62-a86a-4779-9a9b-1c010c89f498`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070827', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639012', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:12:13,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`78f56b62-a86a-4779-9a9b-1c010c89f498`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:12:13,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:12:13,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:12:13,908::task::993::Storage.TaskManager.Task::(_decref) Task=`78f56b62-a86a-4779-9a9b-1c010c89f498`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:12:23,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:12:23,534::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673476 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:12:23,542::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:12:23,551::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730412 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:12:29,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`23b77355-f448-45ca-980a-5aea0101c5f8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:12:29,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:12:29,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673476', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730412', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:12:29,016::task::1191::Storage.TaskManager.Task::(prepare) Task=`23b77355-f448-45ca-980a-5aea0101c5f8`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673476', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730412', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:12:29,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`23b77355-f448-45ca-980a-5aea0101c5f8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:12:29,017::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:12:29,017::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:12:29,017::task::993::Storage.TaskManager.Task::(_decref) Task=`23b77355-f448-45ca-980a-5aea0101c5f8`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:12:33,536::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:12:33,544::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000786582 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:12:33,555::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:12:33,564::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643966 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:12:43,557::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:12:43,565::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000756296 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:12:43,568::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:12:43,575::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069504 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:12:44,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a8147ef-4f86-431c-8aa0-5a087eff4480`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:12:44,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:12:44,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756296', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069504', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:12:44,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a8147ef-4f86-431c-8aa0-5a087eff4480`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756296', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069504', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:12:44,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a8147ef-4f86-431c-8aa0-5a087eff4480`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:12:44,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:12:44,131::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:12:44,131::task::993::Storage.TaskManager.Task::(_decref) Task=`0a8147ef-4f86-431c-8aa0-5a087eff4480`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:12:53,566::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:12:53,575::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000563335 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:12:53,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:12:53,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657932 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:12:59,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee63f3f7-14cf-43d4-984c-a860bafb06f1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:12:59,242::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:12:59,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563335', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657932', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:12:59,242::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee63f3f7-14cf-43d4-984c-a860bafb06f1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563335', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657932', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:12:59,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee63f3f7-14cf-43d4-984c-a860bafb06f1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:12:59,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:12:59,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:12:59,243::task::993::Storage.TaskManager.Task::(_decref) Task=`ee63f3f7-14cf-43d4-984c-a860bafb06f1`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:13:03,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:13:03,584::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694017 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:13:03,590::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:13:03,609::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647081 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:13:13,609::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:13:13,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:13:13,624::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000831448 s, 4.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:13:13,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716568 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:13:14,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`db7f7135-9e27-4580-a33c-0a683fbf0875`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:13:14,353::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:13:14,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000831448', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716568', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:13:14,354::task::1191::Storage.TaskManager.Task::(prepare) Task=`db7f7135-9e27-4580-a33c-0a683fbf0875`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000831448', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716568', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:13:14,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`db7f7135-9e27-4580-a33c-0a683fbf0875`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:13:14,354::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:13:14,354::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:13:14,354::task::993::Storage.TaskManager.Task::(_decref) Task=`db7f7135-9e27-4580-a33c-0a683fbf0875`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:13:23,628::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:13:23,638::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:13:23,639::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647844 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:13:23,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064876 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:13:29,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`121ba2e1-45e4-48fd-b1d2-d36d4216dbcd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:13:29,456::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:13:29,456::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647844', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064876', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:13:29,456::task::1191::Storage.TaskManager.Task::(prepare) Task=`121ba2e1-45e4-48fd-b1d2-d36d4216dbcd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647844', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064876', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:13:29,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`121ba2e1-45e4-48fd-b1d2-d36d4216dbcd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:13:29,457::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:13:29,457::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:13:29,457::task::993::Storage.TaskManager.Task::(_decref) Task=`121ba2e1-45e4-48fd-b1d2-d36d4216dbcd`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:13:33,650::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:13:33,659::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:13:33,660::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697672 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:13:33,677::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632244 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:13:43,679::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:13:43,687::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:13:43,694::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000887323 s, 4.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:13:43,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635478 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:13:44,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`50bb10b0-f1c1-4c44-863c-4f07e35d6157`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:13:44,574::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:13:44,574::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000887323', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635478', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:13:44,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`50bb10b0-f1c1-4c44-863c-4f07e35d6157`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000887323', 'lastCheck': '0.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635478', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:13:44,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`50bb10b0-f1c1-4c44-863c-4f07e35d6157`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:13:44,575::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:13:44,575::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:13:44,575::task::993::Storage.TaskManager.Task::(_decref) Task=`50bb10b0-f1c1-4c44-863c-4f07e35d6157`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:13:53,699::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:13:53,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:13:53,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650249 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:13:53,720::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575376 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:13:59,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`23f8a4d8-0e8e-4a9a-8819-058b50b6cf44`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:13:59,674::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:13:59,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650249', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575376', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:13:59,675::task::1191::Storage.TaskManager.Task::(prepare) Task=`23f8a4d8-0e8e-4a9a-8819-058b50b6cf44`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650249', 'lastCheck': '6.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575376', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:13:59,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`23f8a4d8-0e8e-4a9a-8819-058b50b6cf44`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:13:59,675::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:13:59,675::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:13:59,676::task::993::Storage.TaskManager.Task::(_decref) Task=`23f8a4d8-0e8e-4a9a-8819-058b50b6cf44`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:14:03,721::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:03,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671329 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:03,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:03,760::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062521 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:14:13,760::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 19:14:13,760::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:14:13,761::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:13,768::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 19:14:13,770::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:14:13,771::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:13,771::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0006324 s, 3.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:14:13,778::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0006324 s, 3.2 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:14:13,779::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:14:13,779::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:14:13,779::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:14:13,780::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:14:13,780::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:14:13,781::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:14:13,781::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:14:13,781::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:14:13,782::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:13,789::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000841256 s, 2.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:13,789::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000841256 s, 2.4 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 19:14:13,789::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 19:14:13,790::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 19:14:13,790::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:14:13,791::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 19:14:14,063::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:14:14,063::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:14:14,064::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 19:14:14,065::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::INFO::2014-08-12 19:14:14,066::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-17::DEBUG::2014-08-12 19:14:14,066::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 19:14:14,067::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:14:14,067::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 19:14:14,068::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:14,068::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:14:14,077::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:14:14,077::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:14:14,078::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:14,245::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:14:14,245::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:14,253::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000494956 s, 8.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:14,258::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:14,258::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:14:14,259::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 19:14:14,260::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 19:14:14,260::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 19:14:14,260::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:14:14,260::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:14,427::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:14,428::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:14,436::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528519 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:14:14,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a6cde89-9a27-4700-8804-0639ecb68e48`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:14:14,786::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:14:14,786::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494956', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528519', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:14:14,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a6cde89-9a27-4700-8804-0639ecb68e48`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494956', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528519', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:14:14,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a6cde89-9a27-4700-8804-0639ecb68e48`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:14:14,787::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:14:14,787::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:14:14,787::task::993::Storage.TaskManager.Task::(_decref) Task=`3a6cde89-9a27-4700-8804-0639ecb68e48`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:14:24,256::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:24,265::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701439 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:24,439::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:24,447::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000758782 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:14:29,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f592a14-496c-47cc-8f63-f0901fb2dbe2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:14:29,896::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:14:29,896::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701439', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000758782', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:14:29,897::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f592a14-496c-47cc-8f63-f0901fb2dbe2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701439', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000758782', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:14:29,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f592a14-496c-47cc-8f63-f0901fb2dbe2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:14:29,897::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:14:29,897::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:14:29,897::task::993::Storage.TaskManager.Task::(_decref) Task=`4f592a14-496c-47cc-8f63-f0901fb2dbe2`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:14:34,266::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:34,275::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000774479 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:34,450::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:34,459::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579318 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:14:43,676::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [4018d071] >Thread-15::DEBUG::2014-08-12 19:14:43,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1cd548a-3fd1-4b29-b6a8-be5a4f5becf0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:14:43,677::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) >Thread-15::DEBUG::2014-08-12 19:14:43,679::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 19:14:43,679::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=10,retrans=3,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:44,276::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:44,292::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669506 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:44,463::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:44,470::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000809156 s, 5.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-12 19:14:45,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc06a37e-c715-4ebf-be61-e27d669f09a7`::moving from state init -> state preparing >Thread-28::INFO::2014-08-12 19:14:45,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-08-12 19:14:45,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669506', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809156', 'lastCheck': '0.5', 'valid': True}} >Thread-28::DEBUG::2014-08-12 19:14:45,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc06a37e-c715-4ebf-be61-e27d669f09a7`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669506', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809156', 'lastCheck': '0.5', 'valid': True}} >Thread-28::DEBUG::2014-08-12 19:14:45,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc06a37e-c715-4ebf-be61-e27d669f09a7`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-08-12 19:14:45,022::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-08-12 19:14:45,022::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-08-12 19:14:45,022::task::993::Storage.TaskManager.Task::(_decref) Task=`bc06a37e-c715-4ebf-be61-e27d669f09a7`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:14:48,741::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 19:14:48,741::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:48,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:48,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:48,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:48,742::__init__::225::IOProcess::(_processLogs) (428) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:14:48,742::__init__::225::IOProcess::(_processLogs) (428) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:14:48,743::__init__::225::IOProcess::(_processLogs) (428) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:48,743::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 19:14:48,753::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:14:48,754::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:14:48,754::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:48,754::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:48,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:48,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:48,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:48,755::__init__::225::IOProcess::(_processLogs) (429) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:14:48,755::__init__::225::IOProcess::(_processLogs) (429) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 19:14:48,756::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-29::DEBUG::2014-08-12 19:14:48,756::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(429) Building response >Thread-15::DEBUG::2014-08-12 19:14:48,757::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, b6cdb3e0-8d34-4a62-b549-b76d054a4386: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 19:14:48,757::__init__::225::IOProcess::(_processLogs) (429) Queuing response >Thread-15::INFO::2014-08-12 19:14:48,758::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-29::DEBUG::2014-08-12 19:14:48,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:14:48,759::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1cd548a-3fd1-4b29-b6a8-be5a4f5becf0`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-29::DEBUG::2014-08-12 19:14:48,760::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:14:48,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1cd548a-3fd1-4b29-b6a8-be5a4f5becf0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:14:48,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:14:48,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:14:48,761::task::993::Storage.TaskManager.Task::(_decref) Task=`f1cd548a-3fd1-4b29-b6a8-be5a4f5becf0`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:14:48,803::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 19:14:48,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`716d955a-62bc-43ba-99d8-ee1880fda462`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:14:48,804::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=1, storageType=1, remotePath='netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', options=None) >Thread-15::DEBUG::2014-08-12 19:14:48,804::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:14:48,805::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:14:48,805::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:14:48,805::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:14:48,805::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:14:48,805::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:14:48,829::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:14:48,830::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:14:48,915::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:14:48,915::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:48,916::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:48,916::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:48,916::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:48,916::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:48,917::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:48,917::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:14:48,917::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:48,920::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-15::DEBUG::2014-08-12 19:14:49,191::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:14:49,192::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-29::DEBUG::2014-08-12 19:14:49,194::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,194::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:14:49,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-15::INFO::2014-08-12 19:14:49,197::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': []} >Thread-29::DEBUG::2014-08-12 19:14:49,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-15::DEBUG::2014-08-12 19:14:49,199::task::1191::Storage.TaskManager.Task::(prepare) Task=`716d955a-62bc-43ba-99d8-ee1880fda462`::finished: {'domlist': []} >Thread-29::DEBUG::2014-08-12 19:14:49,200::__init__::225::IOProcess::(_processLogs) (430) Finding callback 'glob'... >Thread-15::DEBUG::2014-08-12 19:14:49,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`716d955a-62bc-43ba-99d8-ee1880fda462`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:14:49,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2014-08-12 19:14:49,201::__init__::225::IOProcess::(_processLogs) (430) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 19:14:49,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-08-12 19:14:49,203::__init__::225::IOProcess::(_processLogs) (430) Building response >Thread-15::DEBUG::2014-08-12 19:14:49,203::task::993::Storage.TaskManager.Task::(_decref) Task=`716d955a-62bc-43ba-99d8-ee1880fda462`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:14:49,205::__init__::225::IOProcess::(_processLogs) (430) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,208::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:14:49,266::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [17e872db] >Thread-15::DEBUG::2014-08-12 19:14:49,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d379a0f-4d68-4235-b072-8ab536fcf506`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:14:49,267::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}], options=None) >Thread-15::DEBUG::2014-08-12 19:14:49,269::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:14:49,270::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:14:49,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-15::DEBUG::2014-08-12 19:14:49,271::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-29::DEBUG::2014-08-12 19:14:49,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-15::DEBUG::2014-08-12 19:14:49,271::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, b6cdb3e0-8d34-4a62-b549-b76d054a4386: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 19:14:49,272::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}]} >Thread-29::DEBUG::2014-08-12 19:14:49,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-15::DEBUG::2014-08-12 19:14:49,273::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d379a0f-4d68-4235-b072-8ab536fcf506`::finished: {'statuslist': [{'status': 0, 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}]} >Thread-15::DEBUG::2014-08-12 19:14:49,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d379a0f-4d68-4235-b072-8ab536fcf506`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 19:14:49,274::__init__::225::IOProcess::(_processLogs) (431) Finding callback 'glob'... >Thread-15::DEBUG::2014-08-12 19:14:49,275::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:14:49,275::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-08-12 19:14:49,275::__init__::225::IOProcess::(_processLogs) (431) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 19:14:49,276::task::993::Storage.TaskManager.Task::(_decref) Task=`3d379a0f-4d68-4235-b072-8ab536fcf506`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:14:49,277::__init__::225::IOProcess::(_processLogs) (431) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,278::__init__::225::IOProcess::(_processLogs) (431) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,279::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,279::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:14:49,299::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [17e872db] >Thread-15::DEBUG::2014-08-12 19:14:49,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`1aaf1e92-8db6-47b2-816a-1e679693771e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:14:49,299::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='875dcd61-503b-4d05-aaea-576145a41424', domainName='pNFS1', typeSpecificArg='netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', domClass=1, domVersion='3', options=None) >Thread-15::DEBUG::2014-08-12 19:14:49,299::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:14:49,300::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:14:49,300::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:14:49,300::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:14:49,300::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:14:49,300::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:14:49,323::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:14:49,325::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:14:49,367::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:14:49,367::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:49,367::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:49,368::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:49,368::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:49,368::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:49,368::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:49,369::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::ERROR::2014-08-12 19:14:49,369::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 875dcd61-503b-4d05-aaea-576145a41424 >Thread-15::ERROR::2014-08-12 19:14:49,369::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 875dcd61-503b-4d05-aaea-576145a41424 >Thread-15::DEBUG::2014-08-12 19:14:49,369::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:14:49,372::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 875dcd61-503b-4d05-aaea-576145a41424 (cwd None) >Thread-15::DEBUG::2014-08-12 19:14:49,557::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "875dcd61-503b-4d05-aaea-576145a41424" not found\n Skipping volume group 875dcd61-503b-4d05-aaea-576145a41424\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 19:14:49,560::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "875dcd61-503b-4d05-aaea-576145a41424" not found', ' Skipping volume group 875dcd61-503b-4d05-aaea-576145a41424'] >Thread-15::DEBUG::2014-08-12 19:14:49,560::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-29::DEBUG::2014-08-12 19:14:49,562::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:14:49,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,562::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-15::ERROR::2014-08-12 19:14:49,564::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 875dcd61-503b-4d05-aaea-576145a41424 not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('875dcd61-503b-4d05-aaea-576145a41424',) >Thread-29::DEBUG::2014-08-12 19:14:49,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-15::INFO::2014-08-12 19:14:49,565::nfsSD::69::Storage.StorageDomain::(create) sdUUID=875dcd61-503b-4d05-aaea-576145a41424 domainName=pNFS1 remotePath=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 domClass=1 >Thread-29::DEBUG::2014-08-12 19:14:49,566::__init__::225::IOProcess::(_processLogs) (432) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:14:49,568::__init__::225::IOProcess::(_processLogs) (432) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:14:49,569::__init__::225::IOProcess::(_processLogs) (432) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,571::__init__::225::IOProcess::(_processLogs) (432) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,572::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,574::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:14:49,576::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 19:14:49,576::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,576::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,576::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,577::__init__::225::IOProcess::(_processLogs) (433) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:14:49,577::__init__::225::IOProcess::(_processLogs) (433) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:14:49,577::__init__::225::IOProcess::(_processLogs) (433) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,577::__init__::225::IOProcess::(_processLogs) (433) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,577::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,583::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:14:49,583::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,583::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,584::__init__::225::IOProcess::(_processLogs) (434) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:14:49,584::__init__::225::IOProcess::(_processLogs) (434) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:14:49,584::__init__::225::IOProcess::(_processLogs) (434) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,584::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,585::__init__::225::IOProcess::(_processLogs) Message size is 141 >Thread-29::DEBUG::2014-08-12 19:14:49,585::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,586::__init__::225::IOProcess::(_processLogs) (435) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:14:49,586::__init__::225::IOProcess::(_processLogs) (435) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:14:49,586::__init__::225::IOProcess::(_processLogs) (435) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,587::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:14:49,587::__init__::225::IOProcess::(_processLogs) Message size is 70 >Thread-29::DEBUG::2014-08-12 19:14:49,588::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,588::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,588::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,589::__init__::225::IOProcess::(_processLogs) (436) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,589::__init__::225::IOProcess::(_processLogs) (436) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,589::__init__::225::IOProcess::(_processLogs) (436) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,589::__init__::225::IOProcess::(_processLogs) (436) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,589::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,589::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,590::__init__::225::IOProcess::(_processLogs) Message size is 74 >Thread-29::DEBUG::2014-08-12 19:14:49,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,591::__init__::225::IOProcess::(_processLogs) (437) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,591::__init__::225::IOProcess::(_processLogs) (437) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,591::__init__::225::IOProcess::(_processLogs) (437) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,591::__init__::225::IOProcess::(_processLogs) (437) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,592::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,592::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,592::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,593::__init__::225::IOProcess::(_processLogs) Message size is 86 >Thread-29::DEBUG::2014-08-12 19:14:49,593::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,594::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,594::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,594::__init__::225::IOProcess::(_processLogs) (438) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,594::__init__::225::IOProcess::(_processLogs) (438) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,594::__init__::225::IOProcess::(_processLogs) (438) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,594::__init__::225::IOProcess::(_processLogs) (438) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,595::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,595::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,595::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,595::__init__::225::IOProcess::(_processLogs) Message size is 90 >Thread-29::DEBUG::2014-08-12 19:14:49,596::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,597::__init__::225::IOProcess::(_processLogs) (439) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,597::__init__::225::IOProcess::(_processLogs) (439) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,597::__init__::225::IOProcess::(_processLogs) (439) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,597::__init__::225::IOProcess::(_processLogs) (439) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,597::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,598::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,598::__init__::225::IOProcess::(_processLogs) Message size is 143 >Thread-29::DEBUG::2014-08-12 19:14:49,598::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,599::__init__::225::IOProcess::(_processLogs) (440) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,599::__init__::225::IOProcess::(_processLogs) (440) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,600::__init__::225::IOProcess::(_processLogs) (440) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,600::__init__::225::IOProcess::(_processLogs) (440) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,600::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,600::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,600::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:14:49,601::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,601::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,601::__init__::225::IOProcess::(_processLogs) (441) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,602::__init__::225::IOProcess::(_processLogs) (441) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,602::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(441) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,602::__init__::225::IOProcess::(_processLogs) (441) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,603::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,603::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,604::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,604::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 19:14:49,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,604::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,605::__init__::225::IOProcess::(_processLogs) (442) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,605::__init__::225::IOProcess::(_processLogs) (442) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,605::__init__::225::IOProcess::(_processLogs) (442) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,606::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,606::__init__::225::IOProcess::(_processLogs) Message size is 229 >Thread-29::DEBUG::2014-08-12 19:14:49,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,607::__init__::225::IOProcess::(_processLogs) (443) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 19:14:49,607::__init__::225::IOProcess::(_processLogs) (443) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 19:14:49,607::__init__::225::IOProcess::(_processLogs) (443) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,608::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,608::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-29::DEBUG::2014-08-12 19:14:49,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,609::__init__::225::IOProcess::(_processLogs) (444) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 19:14:49,609::__init__::225::IOProcess::(_processLogs) (444) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 19:14:49,610::__init__::225::IOProcess::(_processLogs) (444) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,610::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,611::__init__::225::IOProcess::(_processLogs) Message size is 230 >Thread-29::DEBUG::2014-08-12 19:14:49,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,611::__init__::225::IOProcess::(_processLogs) (445) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 19:14:49,611::__init__::225::IOProcess::(_processLogs) (445) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 19:14:49,612::__init__::225::IOProcess::(_processLogs) (445) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,612::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,613::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 19:14:49,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,614::__init__::225::IOProcess::(_processLogs) (446) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 19:14:49,614::__init__::225::IOProcess::(_processLogs) (446) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 19:14:49,614::__init__::225::IOProcess::(_processLogs) (446) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,615::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,615::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-29::DEBUG::2014-08-12 19:14:49,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,615::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,616::__init__::225::IOProcess::(_processLogs) (447) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 19:14:49,616::__init__::225::IOProcess::(_processLogs) (447) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 19:14:49,616::__init__::225::IOProcess::(_processLogs) (447) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,617::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,617::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,617::__init__::225::IOProcess::(_processLogs) Message size is 194 >Thread-29::DEBUG::2014-08-12 19:14:49,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,618::__init__::225::IOProcess::(_processLogs) (448) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 19:14:49,618::__init__::225::IOProcess::(_processLogs) (448) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 19:14:49,618::__init__::225::IOProcess::(_processLogs) (448) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,619::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,619::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-29::DEBUG::2014-08-12 19:14:49,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,620::__init__::225::IOProcess::(_processLogs) (449) Finding callback 'truncate'... >Thread-29::DEBUG::2014-08-12 19:14:49,620::__init__::225::IOProcess::(_processLogs) (449) Got request for method 'truncate' >Thread-29::DEBUG::2014-08-12 19:14:49,621::__init__::225::IOProcess::(_processLogs) (449) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,621::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,621::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-29::DEBUG::2014-08-12 19:14:49,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,622::__init__::225::IOProcess::(_processLogs) (450) Finding callback 'chmod'... >Thread-29::DEBUG::2014-08-12 19:14:49,622::__init__::225::IOProcess::(_processLogs) (450) Got request for method 'chmod' >Thread-29::DEBUG::2014-08-12 19:14:49,623::__init__::225::IOProcess::(_processLogs) (450) Queuing response >Thread-15::DEBUG::2014-08-12 19:14:49,623::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:14:49,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,624::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,625::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:14:49,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-15::DEBUG::2014-08-12 19:14:49,625::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-29::DEBUG::2014-08-12 19:14:49,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-15::DEBUG::2014-08-12 19:14:49,626::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 19:14:49,626::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-29::DEBUG::2014-08-12 19:14:49,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-15::DEBUG::2014-08-12 19:14:49,627::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-29::DEBUG::2014-08-12 19:14:49,627::__init__::225::IOProcess::(_processLogs) (451) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:14:49,628::__init__::225::IOProcess::(_processLogs) (451) Got request for method 'readfile' >Thread-15::DEBUG::2014-08-12 19:14:49,628::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=875dcd61-503b-4d05-aaea-576145a41424', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8d7ef5ce09a700e075d328028ee0b98eb108bbbf'] >Thread-29::DEBUG::2014-08-12 19:14:49,629::__init__::225::IOProcess::(_processLogs) (451) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,629::__init__::225::IOProcess::(_processLogs) (451) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,629::__init__::225::IOProcess::(_processLogs) Sending response sized 93 >Thread-29::DEBUG::2014-08-12 19:14:49,630::__init__::225::IOProcess::(_processLogs) Message size is 644 >Thread-29::DEBUG::2014-08-12 19:14:49,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,630::__init__::225::IOProcess::(_processLogs) (452) Finding callback 'writefile'... >Thread-29::DEBUG::2014-08-12 19:14:49,631::__init__::225::IOProcess::(_processLogs) (452) Got request for method 'writefile' >Thread-29::DEBUG::2014-08-12 19:14:49,631::__init__::225::IOProcess::(_processLogs) (452) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,631::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::WARNING::2014-08-12 19:14:49,631::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-29::DEBUG::2014-08-12 19:14:49,633::__init__::225::IOProcess::(_processLogs) Message size is 333 >Thread-29::DEBUG::2014-08-12 19:14:49,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,634::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,634::__init__::225::IOProcess::(_processLogs) (453) Finding callback 'rename'... >Thread-29::DEBUG::2014-08-12 19:14:49,634::__init__::225::IOProcess::(_processLogs) (453) Got request for method 'rename' >Thread-15::DEBUG::2014-08-12 19:14:49,635::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-29::DEBUG::2014-08-12 19:14:49,635::__init__::225::IOProcess::(_processLogs) (453) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,636::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,636::__init__::225::IOProcess::(_processLogs) Message size is 70 >Thread-29::DEBUG::2014-08-12 19:14:49,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,636::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,637::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,637::__init__::225::IOProcess::(_processLogs) (454) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,637::__init__::225::IOProcess::(_processLogs) (454) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,637::__init__::225::IOProcess::(_processLogs) (454) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,638::__init__::225::IOProcess::(_processLogs) (454) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,638::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,638::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,638::__init__::225::IOProcess::(_processLogs) Message size is 74 >Thread-29::DEBUG::2014-08-12 19:14:49,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,639::__init__::225::IOProcess::(_processLogs) (455) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,640::__init__::225::IOProcess::(_processLogs) (455) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,640::__init__::225::IOProcess::(_processLogs) (455) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,640::__init__::225::IOProcess::(_processLogs) (455) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,640::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,640::__init__::225::IOProcess::(_processLogs) Message size is 86 >Thread-29::DEBUG::2014-08-12 19:14:49,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,642::__init__::225::IOProcess::(_processLogs) (456) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,642::__init__::225::IOProcess::(_processLogs) (456) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,642::__init__::225::IOProcess::(_processLogs) (456) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,642::__init__::225::IOProcess::(_processLogs) (456) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,642::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,643::__init__::225::IOProcess::(_processLogs) Message size is 90 >Thread-29::DEBUG::2014-08-12 19:14:49,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,644::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,644::__init__::225::IOProcess::(_processLogs) (457) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,644::__init__::225::IOProcess::(_processLogs) (457) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,644::__init__::225::IOProcess::(_processLogs) (457) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,644::__init__::225::IOProcess::(_processLogs) (457) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,645::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,645::__init__::225::IOProcess::(_processLogs) Message size is 143 >Thread-29::DEBUG::2014-08-12 19:14:49,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,646::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,646::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,646::__init__::225::IOProcess::(_processLogs) (458) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,647::__init__::225::IOProcess::(_processLogs) (458) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,647::__init__::225::IOProcess::(_processLogs) (458) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,647::__init__::225::IOProcess::(_processLogs) (458) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,647::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,647::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,647::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:14:49,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,648::__init__::225::IOProcess::(_processLogs) (459) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,648::__init__::225::IOProcess::(_processLogs) (459) Got request for method 'mkdir' >Thread-29::DEBUG::2014-08-12 19:14:49,649::__init__::225::IOProcess::(_processLogs) (459) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,649::__init__::225::IOProcess::(_processLogs) Sending response sized 79 >Thread-29::DEBUG::2014-08-12 19:14:49,650::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-29::DEBUG::2014-08-12 19:14:49,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,650::__init__::225::IOProcess::(_processLogs) (460) Finding callback 'mkdir'... >Thread-29::DEBUG::2014-08-12 19:14:49,651::__init__::225::IOProcess::(_processLogs) (460) Got request for method 'mkdir' >Thread-15::DEBUG::2014-08-12 19:14:49,651::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/875dcd61-503b-4d05-aaea-576145a41424 >Thread-29::DEBUG::2014-08-12 19:14:49,651::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(460) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,652::__init__::225::IOProcess::(_processLogs) (460) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,652::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,652::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,653::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:14:49,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,653::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,654::__init__::225::IOProcess::(_processLogs) (461) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:14:49,654::__init__::225::IOProcess::(_processLogs) (461) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:14:49,654::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(461) Building response >Thread-15::DEBUG::2014-08-12 19:14:49,654::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:14:49,655::__init__::225::IOProcess::(_processLogs) (461) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,655::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,656::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,656::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:14:49,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,656::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,656::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,657::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,657::__init__::225::IOProcess::(_processLogs) (462) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:14:49,657::__init__::225::IOProcess::(_processLogs) (462) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 19:14:49,658::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(462) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,658::__init__::225::IOProcess::(_processLogs) (462) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,659::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 19:14:49,659::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=875dcd61-503b-4d05-aaea-576145a41424', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8d7ef5ce09a700e075d328028ee0b98eb108bbbf'] >Thread-29::DEBUG::2014-08-12 19:14:49,659::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 19:14:49,660::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,660::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 19:14:49,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,661::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,662::__init__::225::IOProcess::(_processLogs) (463) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:14:49,662::__init__::225::IOProcess::(_processLogs) (463) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:14:49,662::__init__::225::IOProcess::(_processLogs) (463) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,662::__init__::225::IOProcess::(_processLogs) (463) Queuing response >Thread-29::DEBUG::2014-08-12 19:14:49,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,663::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:14:49,663::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,663::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 19:14:49,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,663::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,664::__init__::225::IOProcess::(_processLogs) (464) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:14:49,664::__init__::225::IOProcess::(_processLogs) (464) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 19:14:49,665::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 19:14:49,665::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(464) Building response >Thread-29::DEBUG::2014-08-12 19:14:49,665::__init__::225::IOProcess::(_processLogs) (464) Queuing response >Thread-15::DEBUG::2014-08-12 19:14:49,666::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '875dcd61-503b-4d05-aaea-576145a41424_imageNS' >Thread-29::DEBUG::2014-08-12 19:14:49,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:14:49,667::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-15::DEBUG::2014-08-12 19:14:49,667::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '875dcd61-503b-4d05-aaea-576145a41424_volumeNS' >Thread-15::DEBUG::2014-08-12 19:14:49,667::clusterlock::143::Storage.initSANLock::(initSANLock) Initializing SANLock for domain 875dcd61-503b-4d05-aaea-576145a41424 >Thread-15::DEBUG::2014-08-12 19:14:49,692::sd::443::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-15::DEBUG::2014-08-12 19:14:49,693::hsm::2685::Storage.HSM::(createStorageDomain) knownSDs: {875dcd61-503b-4d05-aaea-576145a41424: storage.nfsSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, b6cdb3e0-8d34-4a62-b549-b76d054a4386: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 19:14:49,693::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-15::DEBUG::2014-08-12 19:14:49,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`1aaf1e92-8db6-47b2-816a-1e679693771e`::finished: None >Thread-15::DEBUG::2014-08-12 19:14:49,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`1aaf1e92-8db6-47b2-816a-1e679693771e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:14:49,693::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:14:49,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:14:49,694::task::993::Storage.TaskManager.Task::(_decref) Task=`1aaf1e92-8db6-47b2-816a-1e679693771e`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:14:49,753::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [17e872db] >Thread-15::DEBUG::2014-08-12 19:14:49,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aad9801-37f0-4b35-8634-576d17a69260`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:14:49,753::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='875dcd61-503b-4d05-aaea-576145a41424', options=None) >Thread-15::DEBUG::2014-08-12 19:14:49,754::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.875dcd61-503b-4d05-aaea-576145a41424`ReqID=`886705ea-43fc-439b-9921-6dcb9a529ff7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2824' at 'getStorageDomainStats' >Thread-15::DEBUG::2014-08-12 19:14:49,754::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 19:14:49,754::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 19:14:49,754::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.875dcd61-503b-4d05-aaea-576145a41424`ReqID=`886705ea-43fc-439b-9921-6dcb9a529ff7`::Granted request >Thread-15::DEBUG::2014-08-12 19:14:49,754::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0aad9801-37f0-4b35-8634-576d17a69260`::_resourcesAcquired: Storage.875dcd61-503b-4d05-aaea-576145a41424 (shared) >Thread-15::DEBUG::2014-08-12 19:14:49,755::task::993::Storage.TaskManager.Task::(_decref) Task=`0aad9801-37f0-4b35-8634-576d17a69260`::ref 1 aborting False >Thread-29::DEBUG::2014-08-12 19:14:49,755::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:14:49,755::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:14:49,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:14:49,756::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:14:49,756::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:14:49,756::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:14:49,756::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:14:49,756::__init__::225::IOProcess::(_processLogs) (465) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:14:49,756::__init__::225::IOProcess::(_processLogs) (465) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:14:49,757::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(465) Building response >Thread-15::INFO::2014-08-12 19:14:49,757::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21472411648', 'disktotal': '21474836480', 'mdafree': 0}} >Thread-29::DEBUG::2014-08-12 19:14:49,758::__init__::225::IOProcess::(_processLogs) (465) Queuing response >Thread-15::DEBUG::2014-08-12 19:14:49,758::task::1191::Storage.TaskManager.Task::(prepare) Task=`0aad9801-37f0-4b35-8634-576d17a69260`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21472411648', 'disktotal': '21474836480', 'mdafree': 0}} >Thread-29::DEBUG::2014-08-12 19:14:49,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:14:49,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aad9801-37f0-4b35-8634-576d17a69260`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 19:14:49,759::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 19:14:49,759::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.875dcd61-503b-4d05-aaea-576145a41424': < ResourceRef 'Storage.875dcd61-503b-4d05-aaea-576145a41424', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 19:14:49,760::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:14:49,760::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' >Thread-15::DEBUG::2014-08-12 19:14:49,760::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' (0 active users) >Thread-15::DEBUG::2014-08-12 19:14:49,760::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:14:49,760::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424', Clearing records. >Thread-15::DEBUG::2014-08-12 19:14:49,761::task::993::Storage.TaskManager.Task::(_decref) Task=`0aad9801-37f0-4b35-8634-576d17a69260`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:14:54,294::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:14:54,294::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:54,474::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-17::DEBUG::2014-08-12 19:14:54,474::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:54,483::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:14:54,484::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:14:54,494::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000585755 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:54,655::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:14:54,656::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:14:54,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:14:54,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00053399 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:15:00,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`61a863b9-4e9c-48fb-82a9-126d82c94931`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:15:00,128::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:15:00,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585755', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053399', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:15:00,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`61a863b9-4e9c-48fb-82a9-126d82c94931`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585755', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053399', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:15:00,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`61a863b9-4e9c-48fb-82a9-126d82c94931`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:15:00,135::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:15:00,135::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:15:00,135::task::993::Storage.TaskManager.Task::(_decref) Task=`61a863b9-4e9c-48fb-82a9-126d82c94931`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:15:04,495::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:15:04,504::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073948 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:15:04,668::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:15:04,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000755946 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:15:12,644::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [9028456] >Thread-15::DEBUG::2014-08-12 19:15:12,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`684fa140-d420-4f52-addd-3821c806344e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:15:12,645::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}], options=None) >Thread-15::DEBUG::2014-08-12 19:15:12,647::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:15:12,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,648::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:15:12,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,649::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,649::__init__::225::IOProcess::(_processLogs) (466) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:15:12,650::__init__::225::IOProcess::(_processLogs) (466) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 19:15:12,650::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'875dcd61-503b-4d05-aaea-576145a41424',) >Thread-29::DEBUG::2014-08-12 19:15:12,650::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(466) Building response >Thread-15::DEBUG::2014-08-12 19:15:12,651::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {875dcd61-503b-4d05-aaea-576145a41424: storage.nfsSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, b6cdb3e0-8d34-4a62-b549-b76d054a4386: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 19:15:12,652::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}]} >Thread-29::DEBUG::2014-08-12 19:15:12,652::__init__::225::IOProcess::(_processLogs) (466) Queuing response >Thread-15::DEBUG::2014-08-12 19:15:12,652::task::1191::Storage.TaskManager.Task::(prepare) Task=`684fa140-d420-4f52-addd-3821c806344e`::finished: {'statuslist': [{'status': 0, 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}]} >Thread-15::DEBUG::2014-08-12 19:15:12,653::task::595::Storage.TaskManager.Task::(_updateState) Task=`684fa140-d420-4f52-addd-3821c806344e`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 19:15:12,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:15:12,653::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:15:12,654::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-08-12 19:15:12,654::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 19:15:12,654::task::993::Storage.TaskManager.Task::(_decref) Task=`684fa140-d420-4f52-addd-3821c806344e`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:15:12,671::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [9028456] >Thread-15::DEBUG::2014-08-12 19:15:12,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b03255-758d-471c-93d3-0ac7a0131378`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:15:12,671::logUtils::44::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='875dcd61-503b-4d05-aaea-576145a41424', autoDetach=False, options=None) >Thread-15::DEBUG::2014-08-12 19:15:12,671::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:15:12,672::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:15:12,672::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:15:12,672::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:15:12,701::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:15:12,702::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:15:12,786::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:15:12,787::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.875dcd61-503b-4d05-aaea-576145a41424`ReqID=`6f40cb35-4a32-440f-942d-65629d92a7e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2741' at 'formatStorageDomain' >Thread-15::DEBUG::2014-08-12 19:15:12,788::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 19:15:12,788::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 19:15:12,788::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.875dcd61-503b-4d05-aaea-576145a41424`ReqID=`6f40cb35-4a32-440f-942d-65629d92a7e0`::Granted request >Thread-15::DEBUG::2014-08-12 19:15:12,789::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94b03255-758d-471c-93d3-0ac7a0131378`::_resourcesAcquired: Storage.875dcd61-503b-4d05-aaea-576145a41424 (exclusive) >Thread-15::DEBUG::2014-08-12 19:15:12,789::task::993::Storage.TaskManager.Task::(_decref) Task=`94b03255-758d-471c-93d3-0ac7a0131378`::ref 1 aborting False >Thread-15::DEBUG::2014-08-12 19:15:12,789::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:15:12,789::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:15:12,789::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:15:12,789::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:15:12,790::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:15:12,790::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:15:12,812::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:15:12,814::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:15:12,858::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:15:12,859::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:12,859::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:12,859::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:12,859::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:12,860::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:12,860::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:12,860::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-29::DEBUG::2014-08-12 19:15:12,862::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,862::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:15:12,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,863::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,865::__init__::225::IOProcess::(_processLogs) (467) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:15:12,866::__init__::225::IOProcess::(_processLogs) (467) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:15:12,867::__init__::225::IOProcess::(_processLogs) (467) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,869::__init__::225::IOProcess::(_processLogs) (467) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,871::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 19:15:12,873::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/875dcd61-503b-4d05-aaea-576145a41424 >Thread-29::DEBUG::2014-08-12 19:15:12,874::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,874::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:15:12,874::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,874::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,874::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,875::__init__::225::IOProcess::(_processLogs) (468) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:15:12,875::__init__::225::IOProcess::(_processLogs) (468) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:15:12,875::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(468) Building response >Thread-15::DEBUG::2014-08-12 19:15:12,876::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:15:12,876::__init__::225::IOProcess::(_processLogs) (468) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,877::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,878::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,878::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:15:12,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,878::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,879::__init__::225::IOProcess::(_processLogs) (469) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:15:12,879::__init__::225::IOProcess::(_processLogs) (469) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 19:15:12,879::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(469) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,879::__init__::225::IOProcess::(_processLogs) (469) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,880::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-15::DEBUG::2014-08-12 19:15:12,880::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=875dcd61-503b-4d05-aaea-576145a41424', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8d7ef5ce09a700e075d328028ee0b98eb108bbbf'] >Thread-29::DEBUG::2014-08-12 19:15:12,881::__init__::225::IOProcess::(_processLogs) Sending response sized 495 >Thread-29::DEBUG::2014-08-12 19:15:12,882::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,882::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 19:15:12,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,883::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,884::__init__::225::IOProcess::(_processLogs) (470) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:15:12,884::__init__::225::IOProcess::(_processLogs) (470) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:15:12,884::__init__::225::IOProcess::(_processLogs) (470) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,884::__init__::225::IOProcess::(_processLogs) (470) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,885::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,885::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,885::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 19:15:12,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,886::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,886::__init__::225::IOProcess::(_processLogs) (471) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:15:12,886::__init__::225::IOProcess::(_processLogs) (471) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:15:12,887::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(471) Building response >Thread-15::DEBUG::2014-08-12 19:15:12,887::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 19:15:12,887::__init__::225::IOProcess::(_processLogs) (471) Queuing response >Thread-15::INFO::2014-08-12 19:15:12,888::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 875dcd61-503b-4d05-aaea-576145a41424_imageNS already registered >Thread-29::DEBUG::2014-08-12 19:15:12,888::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::INFO::2014-08-12 19:15:12,888::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 875dcd61-503b-4d05-aaea-576145a41424_volumeNS already registered >Thread-29::DEBUG::2014-08-12 19:15:12,889::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:15:12,889::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,890::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:15:12,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,890::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,891::__init__::225::IOProcess::(_processLogs) (472) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:15:12,891::__init__::225::IOProcess::(_processLogs) (472) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 19:15:12,891::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(472) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,891::__init__::225::IOProcess::(_processLogs) (472) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,892::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Sending response sized 495 >Thread-15::DEBUG::2014-08-12 19:15:12,892::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=pNFS1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=875dcd61-503b-4d05-aaea-576145a41424', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=8d7ef5ce09a700e075d328028ee0b98eb108bbbf'] >Thread-15::INFO::2014-08-12 19:15:12,893::fileSD::508::Storage.StorageDomain::(format) Formatting domain 875dcd61-503b-4d05-aaea-576145a41424 >Thread-29::DEBUG::2014-08-12 19:15:12,894::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,894::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:15:12,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,894::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,895::__init__::225::IOProcess::(_processLogs) (473) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:15:12,895::__init__::225::IOProcess::(_processLogs) (473) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:15:12,895::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(473) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,897::__init__::225::IOProcess::(_processLogs) (473) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,900::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-29::DEBUG::2014-08-12 19:15:12,903::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,903::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:15:12,903::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,903::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,904::__init__::225::IOProcess::(_processLogs) (474) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:15:12,904::__init__::225::IOProcess::(_processLogs) (474) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 19:15:12,905::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(474) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,905::__init__::225::IOProcess::(_processLogs) (474) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,905::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,906::__init__::225::IOProcess::(_processLogs) Sending response sized 101 >Thread-29::DEBUG::2014-08-12 19:15:12,906::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,906::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 19:15:12,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,907::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,908::__init__::225::IOProcess::(_processLogs) (475) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:15:12,909::__init__::225::IOProcess::(_processLogs) (475) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:15:12,909::__init__::225::IOProcess::(_processLogs) (475) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,909::__init__::225::IOProcess::(_processLogs) (475) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,909::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,909::__init__::225::IOProcess::(_processLogs) Sending response sized 314 >Thread-29::DEBUG::2014-08-12 19:15:12,909::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,910::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 19:15:12,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,910::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,911::__init__::225::IOProcess::(_processLogs) (476) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:15:12,911::__init__::225::IOProcess::(_processLogs) (476) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 19:15:12,911::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(476) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,912::__init__::225::IOProcess::(_processLogs) (476) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,912::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,912::__init__::225::IOProcess::(_processLogs) Sending response sized 141 >Thread-29::DEBUG::2014-08-12 19:15:12,913::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,913::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 19:15:12,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,913::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,913::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,914::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,915::__init__::225::IOProcess::(_processLogs) (477) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:15:12,915::__init__::225::IOProcess::(_processLogs) (477) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:15:12,915::__init__::225::IOProcess::(_processLogs) (477) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,915::__init__::225::IOProcess::(_processLogs) (477) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,915::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,916::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:15:12,916::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,916::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-29::DEBUG::2014-08-12 19:15:12,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,916::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,916::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,917::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,917::__init__::225::IOProcess::(_processLogs) (478) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:15:12,917::__init__::225::IOProcess::(_processLogs) (478) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:15:12,918::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(478) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,918::__init__::225::IOProcess::(_processLogs) (478) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,918::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,918::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,919::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,919::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:15:12,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,919::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,919::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,920::__init__::225::IOProcess::(_processLogs) (479) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:15:12,920::__init__::225::IOProcess::(_processLogs) (479) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:15:12,921::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(479) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,921::__init__::225::IOProcess::(_processLogs) (479) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,922::__init__::225::IOProcess::(_processLogs) Sending response sized 319 >Thread-29::DEBUG::2014-08-12 19:15:12,922::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,922::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:15:12,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,923::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,923::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,924::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,924::__init__::225::IOProcess::(_processLogs) (480) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:15:12,924::__init__::225::IOProcess::(_processLogs) (480) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:15:12,924::__init__::225::IOProcess::(_processLogs) (480) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,924::__init__::225::IOProcess::(_processLogs) (480) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,924::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,925::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,925::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-29::DEBUG::2014-08-12 19:15:12,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,925::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,926::__init__::225::IOProcess::(_processLogs) (481) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:15:12,926::__init__::225::IOProcess::(_processLogs) (481) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:15:12,927::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(481) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,927::__init__::225::IOProcess::(_processLogs) (481) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,928::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,928::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 19:15:12,928::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,928::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:15:12,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,928::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,929::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,929::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,929::__init__::225::IOProcess::(_processLogs) (482) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:15:12,929::__init__::225::IOProcess::(_processLogs) (482) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:15:12,929::__init__::225::IOProcess::(_processLogs) (482) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,930::__init__::225::IOProcess::(_processLogs) (482) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,930::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,930::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,931::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,931::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-29::DEBUG::2014-08-12 19:15:12,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,931::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,932::__init__::225::IOProcess::(_processLogs) (483) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:15:12,932::__init__::225::IOProcess::(_processLogs) (483) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:15:12,933::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|(483) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,933::__init__::225::IOProcess::(_processLogs) (483) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,934::__init__::225::IOProcess::(_processLogs) Sending response sized 321 >Thread-29::DEBUG::2014-08-12 19:15:12,934::__init__::225::IOProcess::(_processLogs) Message size is 189DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,934::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-29::DEBUG::2014-08-12 19:15:12,934::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,935::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,935::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,935::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,936::__init__::225::IOProcess::(_processLogs) (484) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:15:12,936::__init__::225::IOProcess::(_processLogs) (484) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:15:12,936::__init__::225::IOProcess::(_processLogs) (484) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,936::__init__::225::IOProcess::(_processLogs) (484) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,936::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,937::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,937::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-29::DEBUG::2014-08-12 19:15:12,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,938::__init__::225::IOProcess::(_processLogs) (485) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:15:12,938::__init__::225::IOProcess::(_processLogs) (485) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:15:12,939::__init__::225::IOProcess::(_processLogs) (485) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,939::__init__::225::IOProcess::(_processLogs) Sending response sized 314 >Thread-29::DEBUG::2014-08-12 19:15:12,940::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-29::DEBUG::2014-08-12 19:15:12,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,940::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,940::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,940::__init__::225::IOProcess::(_processLogs) (486) Finding callback 'unlink'... >Thread-29::DEBUG::2014-08-12 19:15:12,941::__init__::225::IOProcess::(_processLogs) (486) Got request for method 'unlink' >Thread-29::DEBUG::2014-08-12 19:15:12,941::__init__::225::IOProcess::(_processLogs) (486) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,942::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,942::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,942::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 19:15:12,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,943::__init__::225::IOProcess::(_processLogs) (487) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:15:12,943::__init__::225::IOProcess::(_processLogs) (487) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 19:15:12,944::__init__::225::IOProcess::(_processLogs) (487) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,944::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,945::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-29::DEBUG::2014-08-12 19:15:12,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,946::__init__::225::IOProcess::(_processLogs) (488) Finding callback 'stat'... >Thread-29::DEBUG::2014-08-12 19:15:12,946::__init__::225::IOProcess::(_processLogs) (488) Got request for method 'stat' >Thread-29::DEBUG::2014-08-12 19:15:12,947::__init__::225::IOProcess::(_processLogs) (488) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,947::__init__::225::IOProcess::(_processLogs) (488) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,947::__init__::225::IOProcess::(_processLogs) Sending response sized 315 >Thread-29::DEBUG::2014-08-12 19:15:12,947::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-29::DEBUG::2014-08-12 19:15:12,947::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,948::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,948::__init__::225::IOProcess::(_processLogs) (489) Finding callback 'listdir'... >Thread-29::DEBUG::2014-08-12 19:15:12,948::__init__::225::IOProcess::(_processLogs) (489) Got request for method 'listdir' >Thread-29::DEBUG::2014-08-12 19:15:12,949::__init__::225::IOProcess::(_processLogs) DEBUG|(489) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,949::__init__::225::IOProcess::(_processLogs) (489) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,950::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:15:12,950::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,950::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-29::DEBUG::2014-08-12 19:15:12,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,950::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,951::__init__::225::IOProcess::(_processLogs) (490) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:15:12,951::__init__::225::IOProcess::(_processLogs) (490) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 19:15:12,952::__init__::225::IOProcess::(_processLogs) DEBUG|(490) Building response >Thread-29::DEBUG::2014-08-12 19:15:12,952::__init__::225::IOProcess::(_processLogs) (490) Queuing response >Thread-29::DEBUG::2014-08-12 19:15:12,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:15:12,952::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:15:12,953::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:15:12,953::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-29::DEBUG::2014-08-12 19:15:12,953::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:15:12,953::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:15:12,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:15:12,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:15:12,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:15:12,954::__init__::225::IOProcess::(_processLogs) (491) Finding callback 'rmdir'... >Thread-29::DEBUG::2014-08-12 19:15:12,954::__init__::225::IOProcess::(_processLogs) (491) Got request for method 'rmdir' >Thread-29::DEBUG::2014-08-12 19:15:12,955::__init__::225::IOProcess::(_processLogs) (491) Queuing response >Thread-15::INFO::2014-08-12 19:15:12,955::logUtils::47::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-29::DEBUG::2014-08-12 19:15:12,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:15:12,956::task::1191::Storage.TaskManager.Task::(prepare) Task=`94b03255-758d-471c-93d3-0ac7a0131378`::finished: None >Thread-29::DEBUG::2014-08-12 19:15:12,957::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 19:15:12,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b03255-758d-471c-93d3-0ac7a0131378`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:15:12,958::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.875dcd61-503b-4d05-aaea-576145a41424': < ResourceRef 'Storage.875dcd61-503b-4d05-aaea-576145a41424', isValid: 'True' obj: 'None'>} >Thread-15::DEBUG::2014-08-12 19:15:12,958::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:15:12,958::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' >Thread-15::DEBUG::2014-08-12 19:15:12,959::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' (0 active users) >Thread-15::DEBUG::2014-08-12 19:15:12,959::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:15:12,959::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.875dcd61-503b-4d05-aaea-576145a41424', Clearing records. >Thread-15::DEBUG::2014-08-12 19:15:12,959::task::993::Storage.TaskManager.Task::(_decref) Task=`94b03255-758d-471c-93d3-0ac7a0131378`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:15:13,076::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [33854940] >Thread-15::DEBUG::2014-08-12 19:15:13,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`5735147f-f1c0-489c-861c-c1917548f0f9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:15:13,077::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'retrans': '3', 'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'timeout': '10', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}], options=None) >Thread-15::DEBUG::2014-08-12 19:15:13,078::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 19:15:13,109::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:15:13,109::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:15:13,109::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:15:13,110::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:15:13,110::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:15:13,110::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:15:13,133::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:15:13,134::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:15:13,176::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:15:13,177::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:13,177::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:13,177::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:13,178::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:13,178::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:13,178::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:15:13,178::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 19:15:13,178::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}]} >Thread-15::DEBUG::2014-08-12 19:15:13,179::task::1191::Storage.TaskManager.Task::(prepare) Task=`5735147f-f1c0-489c-861c-c1917548f0f9`::finished: {'statuslist': [{'status': 0, 'id': 'd13451cf-9234-433e-aa63-faa9fc7834f9'}]} >Thread-15::DEBUG::2014-08-12 19:15:13,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`5735147f-f1c0-489c-861c-c1917548f0f9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:15:13,179::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:15:13,179::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:15:13,179::task::993::Storage.TaskManager.Task::(_decref) Task=`5735147f-f1c0-489c-861c-c1917548f0f9`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:15:14,506::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:15:14,509::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:15:14,680::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-17::DEBUG::2014-08-12 19:15:14,681::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:15:14,791::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:15:14,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:15:14,801::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000536785 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:15:14,865::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:15:14,866::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:15:14,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:15:14,874::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000513664 s, 8.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:15:15,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`138c64ee-c6f2-4659-8756-58fa574fb9c6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:15:15,250::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:15:15,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536785', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513664', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:15:15,251::task::1191::Storage.TaskManager.Task::(prepare) Task=`138c64ee-c6f2-4659-8756-58fa574fb9c6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536785', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513664', 'lastCheck': '0.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:15:15,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`138c64ee-c6f2-4659-8756-58fa574fb9c6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:15:15,251::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:15:15,251::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:15:15,251::task::993::Storage.TaskManager.Task::(_decref) Task=`138c64ee-c6f2-4659-8756-58fa574fb9c6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:15:24,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:15:24,812::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665734 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:15:24,877::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:15:24,886::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728135 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:15:30,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4a286ed-cb0b-43fb-856a-c41f8fd5853f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:15:30,389::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:15:30,390::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665734', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728135', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:15:30,390::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4a286ed-cb0b-43fb-856a-c41f8fd5853f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665734', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000728135', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:15:30,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4a286ed-cb0b-43fb-856a-c41f8fd5853f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:15:30,390::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:15:30,390::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:15:30,390::task::993::Storage.TaskManager.Task::(_decref) Task=`d4a286ed-cb0b-43fb-856a-c41f8fd5853f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:15:34,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:15:34,821::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720206 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:15:34,889::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:15:34,897::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645363 s, 6.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:15:44,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:15:44,831::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708202 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:15:44,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:15:44,908::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622874 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:15:45,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1c32909-71b7-497d-a6e2-64aa81a63dbd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:15:45,505::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:15:45,505::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708202', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622874', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:15:45,506::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1c32909-71b7-497d-a6e2-64aa81a63dbd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708202', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622874', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:15:45,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1c32909-71b7-497d-a6e2-64aa81a63dbd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:15:45,506::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:15:45,506::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:15:45,506::task::993::Storage.TaskManager.Task::(_decref) Task=`b1c32909-71b7-497d-a6e2-64aa81a63dbd`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:15:54,833::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:15:54,841::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000566881 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:15:54,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:15:54,919::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010616 s, 3.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:16:00,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`18c3ca44-1a5b-4a64-ae53-0c2b22881ebf`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:16:00,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:16:00,655::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566881', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010616', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:16:00,655::task::1191::Storage.TaskManager.Task::(prepare) Task=`18c3ca44-1a5b-4a64-ae53-0c2b22881ebf`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566881', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010616', 'lastCheck': '5.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:16:00,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`18c3ca44-1a5b-4a64-ae53-0c2b22881ebf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:16:00,655::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:16:00,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:16:00,656::task::993::Storage.TaskManager.Task::(_decref) Task=`18c3ca44-1a5b-4a64-ae53-0c2b22881ebf`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:16:04,843::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:16:04,851::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692917 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:16:04,923::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:16:04,932::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634079 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:16:14,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:16:14,861::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780678 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:16:14,935::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:16:14,943::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651569 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:16:15,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bb960bc-a5b6-4cbc-896e-d8efd1224e17`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:16:15,825::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:16:15,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780678', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651569', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:16:15,825::task::1191::Storage.TaskManager.Task::(prepare) Task=`6bb960bc-a5b6-4cbc-896e-d8efd1224e17`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000780678', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651569', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:16:15,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bb960bc-a5b6-4cbc-896e-d8efd1224e17`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:16:15,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:16:15,826::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:16:15,826::task::993::Storage.TaskManager.Task::(_decref) Task=`6bb960bc-a5b6-4cbc-896e-d8efd1224e17`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:16:24,863::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:16:24,872::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679935 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:16:24,946::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:16:24,954::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:16:30,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`62d0139a-e906-4c6b-8a06-4e25995aa600`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:16:30,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:16:30,960::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679935', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:16:30,960::task::1191::Storage.TaskManager.Task::(prepare) Task=`62d0139a-e906-4c6b-8a06-4e25995aa600`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679935', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752', 'lastCheck': '6.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:16:30,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`62d0139a-e906-4c6b-8a06-4e25995aa600`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:16:30,960::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:16:30,960::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:16:30,961::task::993::Storage.TaskManager.Task::(_decref) Task=`62d0139a-e906-4c6b-8a06-4e25995aa600`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:16:34,874::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:16:34,882::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704235 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:16:34,957::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:16:34,966::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628275 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:16:44,892::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:16:44,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000819735 s, 5.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:16:44,969::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:16:44,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620802 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:16:46,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`45990a76-3d8d-491c-91d3-8a4cf12c8cc4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:16:46,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:16:46,088::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819735', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620802', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:16:46,088::task::1191::Storage.TaskManager.Task::(prepare) Task=`45990a76-3d8d-491c-91d3-8a4cf12c8cc4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819735', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620802', 'lastCheck': '1.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:16:46,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`45990a76-3d8d-491c-91d3-8a4cf12c8cc4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:16:46,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:16:46,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:16:46,089::task::993::Storage.TaskManager.Task::(_decref) Task=`45990a76-3d8d-491c-91d3-8a4cf12c8cc4`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:16:54,902::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:16:54,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642311 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:16:54,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:16:54,986::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00069535 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:17:01,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`b321db97-8589-4e4c-9745-0dc113df4cee`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:17:01,203::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:17:01,203::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642311', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069535', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:17:01,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`b321db97-8589-4e4c-9745-0dc113df4cee`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642311', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00069535', 'lastCheck': '6.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:17:01,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`b321db97-8589-4e4c-9745-0dc113df4cee`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:17:01,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:17:01,204::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:17:01,204::task::993::Storage.TaskManager.Task::(_decref) Task=`b321db97-8589-4e4c-9745-0dc113df4cee`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:17:04,912::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:17:04,920::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657567 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:17:04,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:17:04,998::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625352 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:17:14,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:17:14,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640316 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:17:15,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:17:15,008::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644431 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:17:16,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb2d88f9-f5ac-4423-a600-595396c458c1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:17:16,316::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:17:16,316::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640316', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644431', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:17:16,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb2d88f9-f5ac-4423-a600-595396c458c1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640316', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644431', 'lastCheck': '1.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:17:16,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb2d88f9-f5ac-4423-a600-595396c458c1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:17:16,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:17:16,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:17:16,317::task::993::Storage.TaskManager.Task::(_decref) Task=`fb2d88f9-f5ac-4423-a600-595396c458c1`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:17:24,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:17:24,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636112 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:17:25,011::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:17:25,019::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700118 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:17:31,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`51e31486-f9a2-4ab4-a83e-c20ba78a01ec`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:17:31,427::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:17:31,428::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636112', 'lastCheck': '6.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700118', 'lastCheck': '6.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:17:31,428::task::1191::Storage.TaskManager.Task::(prepare) Task=`51e31486-f9a2-4ab4-a83e-c20ba78a01ec`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636112', 'lastCheck': '6.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700118', 'lastCheck': '6.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:17:31,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`51e31486-f9a2-4ab4-a83e-c20ba78a01ec`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:17:31,428::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:17:31,428::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:17:31,428::task::993::Storage.TaskManager.Task::(_decref) Task=`51e31486-f9a2-4ab4-a83e-c20ba78a01ec`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:17:34,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:17:34,950::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689808 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:17:35,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:17:35,031::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630804 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:17:44,951::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:17:44,959::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729885 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:17:45,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:17:45,041::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701313 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:17:46,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`948fdb27-7a48-49ed-950d-9f54f957d7d1`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:17:46,546::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:17:46,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729885', 'lastCheck': '1.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701313', 'lastCheck': '1.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:17:46,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`948fdb27-7a48-49ed-950d-9f54f957d7d1`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729885', 'lastCheck': '1.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000701313', 'lastCheck': '1.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:17:46,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`948fdb27-7a48-49ed-950d-9f54f957d7d1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:17:46,547::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:17:46,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:17:46,547::task::993::Storage.TaskManager.Task::(_decref) Task=`948fdb27-7a48-49ed-950d-9f54f957d7d1`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:17:54,970::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:17:54,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634249 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:17:55,045::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:17:55,053::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713138 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:18:01,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`e488ab07-e2fc-4a01-be57-e03bd298bb7a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:18:01,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:18:01,666::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634249', 'lastCheck': '6.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713138', 'lastCheck': '6.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:18:01,666::task::1191::Storage.TaskManager.Task::(prepare) Task=`e488ab07-e2fc-4a01-be57-e03bd298bb7a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634249', 'lastCheck': '6.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713138', 'lastCheck': '6.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:18:01,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`e488ab07-e2fc-4a01-be57-e03bd298bb7a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:18:01,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:18:01,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:18:01,667::task::993::Storage.TaskManager.Task::(_decref) Task=`e488ab07-e2fc-4a01-be57-e03bd298bb7a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:18:04,981::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:18:04,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696012 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:18:05,056::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:18:05,065::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644197 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:18:14,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:18:14,997::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621818 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:18:15,068::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:18:15,075::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601355 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:18:16,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a48ba70-3ca9-481b-ae7b-53a6b5a50679`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:18:16,792::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:18:16,792::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621818', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601355', 'lastCheck': '1.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:18:16,792::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a48ba70-3ca9-481b-ae7b-53a6b5a50679`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621818', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601355', 'lastCheck': '1.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:18:16,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a48ba70-3ca9-481b-ae7b-53a6b5a50679`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:18:16,792::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:18:16,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:18:16,793::task::993::Storage.TaskManager.Task::(_decref) Task=`0a48ba70-3ca9-481b-ae7b-53a6b5a50679`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:18:25,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:18:25,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680399 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:18:25,078::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:18:25,086::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657971 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:18:31,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d7a5359-be0f-4580-ab38-a0571ab3697d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:18:31,905::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:18:31,905::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680399', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657971', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:18:31,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d7a5359-be0f-4580-ab38-a0571ab3697d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680399', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657971', 'lastCheck': '6.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:18:31,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d7a5359-be0f-4580-ab38-a0571ab3697d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:18:31,906::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:18:31,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:18:31,906::task::993::Storage.TaskManager.Task::(_decref) Task=`6d7a5359-be0f-4580-ab38-a0571ab3697d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:18:35,011::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:18:35,018::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708689 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:18:35,089::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:18:35,098::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638835 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:18:45,020::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:18:45,027::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687251 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:18:45,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:18:45,108::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607025 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:18:47,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4405500-0873-42ae-b7ea-9cfd638d230a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:18:47,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:18:47,046::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687251', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607025', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:18:47,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4405500-0873-42ae-b7ea-9cfd638d230a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687251', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607025', 'lastCheck': '1.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:18:47,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4405500-0873-42ae-b7ea-9cfd638d230a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:18:47,047::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:18:47,047::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:18:47,047::task::993::Storage.TaskManager.Task::(_decref) Task=`c4405500-0873-42ae-b7ea-9cfd638d230a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:18:55,042::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:18:55,052::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596363 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:18:55,111::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:18:55,118::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642948 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:19:02,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0c11ca-a127-4b6d-8bcf-d704f2b0305a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:19:02,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:19:02,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596363', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642948', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:19:02,195::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa0c11ca-a127-4b6d-8bcf-d704f2b0305a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596363', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642948', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:19:02,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0c11ca-a127-4b6d-8bcf-d704f2b0305a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:19:02,195::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:19:02,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:19:02,195::task::993::Storage.TaskManager.Task::(_decref) Task=`aa0c11ca-a127-4b6d-8bcf-d704f2b0305a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:19:05,053::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:19:05,063::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690193 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:05,122::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:05,129::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000559033 s, 7.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:19:15,065::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 19:19:15,065::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:19:15,066::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:19:15,074::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000567037 s, 3.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:19:15,074::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000567037 s, 3.6 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:19:15,074::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:19:15,075::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:19:15,075::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:19:15,075::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:19:15,075::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:19:15,076::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:19:15,076::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:19:15,076::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:19:15,076::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:15,132::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 19:19:15,133::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:19:15,134::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:15,144::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000544538 s, 3.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:15,144::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000544538 s, 3.8 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 19:19:15,144::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 19:19:15,144::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 19:19:15,145::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:19:15,145::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 19:19:15,324::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:19:15,325::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:19:15,326::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 19:19:15,327::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:19:15,330::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 19:19:15,330::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 19:19:15,331::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:19:15,332::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:19:15,332::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:19:15,334::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:15,343::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:19:15,344::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:19:15,344::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:19:15,502::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:19:15,503::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:19:15,511::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000464523 s, 8.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:15,525::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:15,526::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:19:15,526::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 19:19:15,527::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 19:19:15,527::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 19:19:15,527::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:19:15,528::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:15,694::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:15,695::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:15,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00053229 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:19:17,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`1aeb47f9-b671-4931-b3ea-8b4731a76aab`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:19:17,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:19:17,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464523', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053229', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:19:17,325::task::1191::Storage.TaskManager.Task::(prepare) Task=`1aeb47f9-b671-4931-b3ea-8b4731a76aab`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464523', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053229', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:19:17,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`1aeb47f9-b671-4931-b3ea-8b4731a76aab`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:19:17,325::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:19:17,325::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:19:17,325::task::993::Storage.TaskManager.Task::(_decref) Task=`1aeb47f9-b671-4931-b3ea-8b4731a76aab`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:19:25,513::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:19:25,521::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636645 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:25,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:25,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700978 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:19:32,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`3aacb0e5-54c4-44cd-8c19-9dbaa9240689`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:19:32,431::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:19:32,431::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636645', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700978', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:19:32,431::task::1191::Storage.TaskManager.Task::(prepare) Task=`3aacb0e5-54c4-44cd-8c19-9dbaa9240689`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636645', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700978', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:19:32,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`3aacb0e5-54c4-44cd-8c19-9dbaa9240689`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:19:32,432::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:19:32,432::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:19:32,432::task::993::Storage.TaskManager.Task::(_decref) Task=`3aacb0e5-54c4-44cd-8c19-9dbaa9240689`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:19:35,522::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:19:35,531::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694177 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:35,718::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:35,726::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670907 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:19:45,533::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:19:45,543::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706061 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:45,729::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:45,737::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619031 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:19:47,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`82149ec6-8390-4d36-95fb-30ee263b34ee`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:19:47,538::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:19:47,538::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706061', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619031', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:19:47,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`82149ec6-8390-4d36-95fb-30ee263b34ee`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706061', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619031', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:19:47,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`82149ec6-8390-4d36-95fb-30ee263b34ee`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:19:47,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:19:47,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:19:47,539::task::993::Storage.TaskManager.Task::(_decref) Task=`82149ec6-8390-4d36-95fb-30ee263b34ee`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:19:55,545::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:19:55,554::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066248 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:19:55,740::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:19:55,749::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000743765 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:20:02,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a262488-e6d4-43a7-a08f-dbc807fac5bd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:20:02,641::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:20:02,641::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066248', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743765', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:20:02,641::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a262488-e6d4-43a7-a08f-dbc807fac5bd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066248', 'lastCheck': '7.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743765', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:20:02,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a262488-e6d4-43a7-a08f-dbc807fac5bd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:20:02,642::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:20:02,642::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:20:02,642::task::993::Storage.TaskManager.Task::(_decref) Task=`9a262488-e6d4-43a7-a08f-dbc807fac5bd`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:20:05,555::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:20:05,566::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680573 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:20:05,752::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:20:05,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799552 s, 5.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:20:15,567::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:20:15,576::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726151 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:20:15,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:20:15,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747688 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:20:17,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`595d7b87-9691-42a3-b846-2ba1b4acfb40`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:20:17,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:20:17,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726151', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000747688', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:20:17,756::task::1191::Storage.TaskManager.Task::(prepare) Task=`595d7b87-9691-42a3-b846-2ba1b4acfb40`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000726151', 'lastCheck': '2.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000747688', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:20:17,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`595d7b87-9691-42a3-b846-2ba1b4acfb40`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:20:17,757::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:20:17,757::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:20:17,757::task::993::Storage.TaskManager.Task::(_decref) Task=`595d7b87-9691-42a3-b846-2ba1b4acfb40`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:20:25,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:20:25,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664522 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:20:25,780::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:20:25,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764695 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:20:32,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`939a1de2-ef59-4848-8e9e-2e18aa2ab06d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:20:32,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:20:32,867::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664522', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764695', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:20:32,867::task::1191::Storage.TaskManager.Task::(prepare) Task=`939a1de2-ef59-4848-8e9e-2e18aa2ab06d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664522', 'lastCheck': '7.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764695', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:20:32,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`939a1de2-ef59-4848-8e9e-2e18aa2ab06d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:20:32,867::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:20:32,867::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:20:32,867::task::993::Storage.TaskManager.Task::(_decref) Task=`939a1de2-ef59-4848-8e9e-2e18aa2ab06d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:20:35,587::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:20:35,596::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670619 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:20:35,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:20:35,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722624 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:20:45,597::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:20:45,605::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714512 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:20:45,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:20:45,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601175 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:20:47,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`06e5fdab-5424-40c5-8ae5-f9c6dacf6c50`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:20:47,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:20:47,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714512', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601175', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:20:47,989::task::1191::Storage.TaskManager.Task::(prepare) Task=`06e5fdab-5424-40c5-8ae5-f9c6dacf6c50`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714512', 'lastCheck': '2.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601175', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:20:47,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`06e5fdab-5424-40c5-8ae5-f9c6dacf6c50`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:20:47,990::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:20:47,990::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:20:47,990::task::993::Storage.TaskManager.Task::(_decref) Task=`06e5fdab-5424-40c5-8ae5-f9c6dacf6c50`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:20:55,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:20:55,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000541727 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:20:55,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:20:55,822::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073364 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:21:03,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ae45557-59fb-425d-8e73-a599deab2116`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:21:03,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:21:03,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541727', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073364', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:21:03,096::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ae45557-59fb-425d-8e73-a599deab2116`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541727', 'lastCheck': '7.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073364', 'lastCheck': '7.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:21:03,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ae45557-59fb-425d-8e73-a599deab2116`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:21:03,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:21:03,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:21:03,096::task::993::Storage.TaskManager.Task::(_decref) Task=`2ae45557-59fb-425d-8e73-a599deab2116`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:21:05,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:21:05,625::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688184 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:21:05,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:21:05,834::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641435 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:21:15,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:21:15,635::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617618 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:21:15,837::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:21:15,844::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620051 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:21:18,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`614ec956-56af-495a-89d1-fa9e9cd113b5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:21:18,207::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:21:18,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617618', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620051', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:21:18,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`614ec956-56af-495a-89d1-fa9e9cd113b5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617618', 'lastCheck': '2.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620051', 'lastCheck': '2.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:21:18,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`614ec956-56af-495a-89d1-fa9e9cd113b5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:21:18,208::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:21:18,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:21:18,208::task::993::Storage.TaskManager.Task::(_decref) Task=`614ec956-56af-495a-89d1-fa9e9cd113b5`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:21:25,637::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:21:25,645::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597008 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:21:25,847::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:21:25,856::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729843 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:21:33,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`c64a5ed4-a37c-4763-810a-aa94177a194c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:21:33,316::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:21:33,316::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597008', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729843', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:21:33,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`c64a5ed4-a37c-4763-810a-aa94177a194c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597008', 'lastCheck': '7.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729843', 'lastCheck': '7.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:21:33,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`c64a5ed4-a37c-4763-810a-aa94177a194c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:21:33,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:21:33,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:21:33,317::task::993::Storage.TaskManager.Task::(_decref) Task=`c64a5ed4-a37c-4763-810a-aa94177a194c`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:21:35,646::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:21:35,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712553 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:21:35,859::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:21:35,867::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000612965 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:21:45,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:21:45,664::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620236 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:21:45,871::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:21:45,878::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010373 s, 3.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:21:48,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1e342a9-2ddf-494b-a329-1464e14f3dd5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:21:48,487::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:21:48,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620236', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010373', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:21:48,488::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1e342a9-2ddf-494b-a329-1464e14f3dd5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620236', 'lastCheck': '2.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010373', 'lastCheck': '2.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:21:48,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1e342a9-2ddf-494b-a329-1464e14f3dd5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:21:48,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:21:48,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:21:48,488::task::993::Storage.TaskManager.Task::(_decref) Task=`b1e342a9-2ddf-494b-a329-1464e14f3dd5`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:21:55,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:21:55,674::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059656 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:21:55,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:21:55,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00074863 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:22:03,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9865cc3-434b-4409-b660-a422a6266099`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:22:03,596::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:22:03,596::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059656', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074863', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:22:03,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9865cc3-434b-4409-b660-a422a6266099`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059656', 'lastCheck': '7.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074863', 'lastCheck': '7.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:22:03,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9865cc3-434b-4409-b660-a422a6266099`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:22:03,597::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:22:03,597::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:22:03,597::task::993::Storage.TaskManager.Task::(_decref) Task=`a9865cc3-434b-4409-b660-a422a6266099`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:22:05,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:22:05,684::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666749 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:22:05,893::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:22:05,901::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696452 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:22:15,685::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:22:15,696::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631846 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:22:15,905::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:22:15,913::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675682 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:22:18,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`61fa15b1-3edf-47a8-a3f5-a8dec6ff4eae`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:22:18,713::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:22:18,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631846', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675682', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:22:18,714::task::1191::Storage.TaskManager.Task::(prepare) Task=`61fa15b1-3edf-47a8-a3f5-a8dec6ff4eae`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631846', 'lastCheck': '3.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675682', 'lastCheck': '2.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:22:18,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`61fa15b1-3edf-47a8-a3f5-a8dec6ff4eae`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:22:18,714::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:22:18,714::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:22:18,714::task::993::Storage.TaskManager.Task::(_decref) Task=`61fa15b1-3edf-47a8-a3f5-a8dec6ff4eae`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:22:25,700::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:22:25,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000767201 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:22:25,916::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:22:25,925::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593981 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:22:33,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`f68f698e-f69c-4834-ba24-1bfe58386b50`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:22:33,830::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:22:33,830::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000767201', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593981', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:22:33,830::task::1191::Storage.TaskManager.Task::(prepare) Task=`f68f698e-f69c-4834-ba24-1bfe58386b50`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000767201', 'lastCheck': '8.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593981', 'lastCheck': '7.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:22:33,830::task::595::Storage.TaskManager.Task::(_updateState) Task=`f68f698e-f69c-4834-ba24-1bfe58386b50`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:22:33,830::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:22:33,830::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:22:33,831::task::993::Storage.TaskManager.Task::(_decref) Task=`f68f698e-f69c-4834-ba24-1bfe58386b50`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:22:35,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:22:35,722::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699989 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:22:35,929::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:22:35,937::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660508 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:22:45,723::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:22:45,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063513 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:22:45,940::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:22:45,948::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597527 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:22:48,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b39eb57-1e08-4ce1-a437-2d781bf2e5e6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:22:48,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:22:48,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063513', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597527', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:22:48,937::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b39eb57-1e08-4ce1-a437-2d781bf2e5e6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063513', 'lastCheck': '3.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597527', 'lastCheck': '3.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:22:48,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b39eb57-1e08-4ce1-a437-2d781bf2e5e6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:22:48,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:22:48,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:22:48,938::task::993::Storage.TaskManager.Task::(_decref) Task=`8b39eb57-1e08-4ce1-a437-2d781bf2e5e6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:22:55,734::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:22:55,742::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604427 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:22:55,951::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:22:55,959::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700263 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:23:04,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d8df702-84ba-4e4a-beb4-f8f64b3e8001`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:23:04,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:23:04,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604427', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700263', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:23:04,043::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d8df702-84ba-4e4a-beb4-f8f64b3e8001`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604427', 'lastCheck': '8.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700263', 'lastCheck': '8.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:23:04,044::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d8df702-84ba-4e4a-beb4-f8f64b3e8001`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:23:04,044::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:23:04,044::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:23:04,044::task::993::Storage.TaskManager.Task::(_decref) Task=`5d8df702-84ba-4e4a-beb4-f8f64b3e8001`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:23:05,746::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:23:05,754::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730322 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:23:05,962::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:23:05,971::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591364 s, 6.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:23:15,755::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:23:15,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000686159 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:23:15,986::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:23:15,993::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000740454 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:23:19,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`f881ec96-9176-4348-87fd-de61e5b0b918`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:23:19,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:23:19,158::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686159', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740454', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:23:19,158::task::1191::Storage.TaskManager.Task::(prepare) Task=`f881ec96-9176-4348-87fd-de61e5b0b918`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686159', 'lastCheck': '3.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740454', 'lastCheck': '3.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:23:19,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`f881ec96-9176-4348-87fd-de61e5b0b918`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:23:19,159::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:23:19,159::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:23:19,159::task::993::Storage.TaskManager.Task::(_decref) Task=`f881ec96-9176-4348-87fd-de61e5b0b918`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:23:25,766::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:23:25,774::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660977 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:23:25,996::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:23:26,005::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000742646 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:23:34,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`9215e951-b8fa-4ef5-9ae1-5afbb50ae27a`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:23:34,269::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:23:34,269::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660977', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742646', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:23:34,269::task::1191::Storage.TaskManager.Task::(prepare) Task=`9215e951-b8fa-4ef5-9ae1-5afbb50ae27a`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660977', 'lastCheck': '8.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742646', 'lastCheck': '8.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:23:34,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`9215e951-b8fa-4ef5-9ae1-5afbb50ae27a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:23:34,269::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:23:34,270::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:23:34,270::task::993::Storage.TaskManager.Task::(_decref) Task=`9215e951-b8fa-4ef5-9ae1-5afbb50ae27a`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:23:35,776::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:23:35,784::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597463 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:23:36,009::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:23:36,018::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540115 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:23:45,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:23:45,804::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716409 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:23:46,021::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:23:46,028::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000645295 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:23:49,375::task::595::Storage.TaskManager.Task::(_updateState) Task=`5803478f-93bb-4e7e-a3a6-c696d5124580`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:23:49,376::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:23:49,376::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716409', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645295', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:23:49,376::task::1191::Storage.TaskManager.Task::(prepare) Task=`5803478f-93bb-4e7e-a3a6-c696d5124580`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000716409', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645295', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:23:49,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`5803478f-93bb-4e7e-a3a6-c696d5124580`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:23:49,377::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:23:49,377::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:23:49,377::task::993::Storage.TaskManager.Task::(_decref) Task=`5803478f-93bb-4e7e-a3a6-c696d5124580`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:23:55,806::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:23:55,815::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616045 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:23:56,031::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:23:56,040::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544982 s, 7.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:24:04,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e278042-28e1-4fc5-8798-10394611f1bb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:24:04,483::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:24:04,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616045', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544982', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:24:04,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e278042-28e1-4fc5-8798-10394611f1bb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616045', 'lastCheck': '8.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544982', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:24:04,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e278042-28e1-4fc5-8798-10394611f1bb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:24:04,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:24:04,484::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:24:04,485::task::993::Storage.TaskManager.Task::(_decref) Task=`8e278042-28e1-4fc5-8798-10394611f1bb`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:24:05,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:24:05,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670901 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:24:06,043::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:06,052::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632676 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:24:15,826::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 19:24:15,826::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:24:15,834::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:24:15,843::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000527453 s, 3.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:24:15,843::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000527453 s, 3.9 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:24:15,843::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:24:15,843::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:24:15,844::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:24:15,844::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:24:15,844::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:24:15,844::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:24:15,845::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:24:15,845::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:24:15,845::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:16,055::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 19:24:16,056::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:24:16,057::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:16,066::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000514972 s, 4.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:24:16,066::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000514972 s, 4.0 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 19:24:16,067::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 19:24:16,067::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 19:24:16,067::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:24:16,067::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 19:24:16,117::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:24:16,117::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:24:16,118::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 19:24:16,119::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:24:16,121::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 19:24:16,122::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 19:24:16,123::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:24:16,123::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:24:16,124::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:24:16,125::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:16,133::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:24:16,134::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:24:16,134::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:24:16,308::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:24:16,309::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:16,318::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:24:16,319::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709187 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:24:16,322::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:24:16,322::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 19:24:16,324::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 19:24:16,324::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 19:24:16,325::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:24:16,325::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:16,491::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:24:16,492::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:16,501::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572986 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:24:19,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`05f59b14-a756-4da7-9f30-f51c521a0424`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:24:19,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:24:19,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709187', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572986', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:24:19,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`05f59b14-a756-4da7-9f30-f51c521a0424`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709187', 'lastCheck': '3.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572986', 'lastCheck': '3.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:24:19,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`05f59b14-a756-4da7-9f30-f51c521a0424`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:24:19,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:24:19,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:24:19,589::task::993::Storage.TaskManager.Task::(_decref) Task=`05f59b14-a756-4da7-9f30-f51c521a0424`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:24:26,324::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:24:26,333::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675629 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:24:26,504::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:26,513::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00075982 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:24:34,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`6484c99c-681a-4282-8cfc-acb63c6bff2e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:24:34,706::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:24:34,706::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675629', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075982', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:24:34,706::task::1191::Storage.TaskManager.Task::(prepare) Task=`6484c99c-681a-4282-8cfc-acb63c6bff2e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675629', 'lastCheck': '8.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075982', 'lastCheck': '8.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:24:34,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`6484c99c-681a-4282-8cfc-acb63c6bff2e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:24:34,706::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:24:34,707::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:24:34,707::task::993::Storage.TaskManager.Task::(_decref) Task=`6484c99c-681a-4282-8cfc-acb63c6bff2e`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:24:36,334::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:24:36,344::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631867 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:24:36,516::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:36,523::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622194 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:24:46,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:24:46,353::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652917 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:24:46,527::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:46,534::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00058096 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:24:49,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`9058f98c-0a66-4981-9041-2fb4dbad2869`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:24:49,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:24:49,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652917', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058096', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:24:49,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`9058f98c-0a66-4981-9041-2fb4dbad2869`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652917', 'lastCheck': '3.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058096', 'lastCheck': '3.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:24:49,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`9058f98c-0a66-4981-9041-2fb4dbad2869`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:24:49,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:24:49,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:24:49,818::task::993::Storage.TaskManager.Task::(_decref) Task=`9058f98c-0a66-4981-9041-2fb4dbad2869`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:24:56,355::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:24:56,364::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674281 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:24:56,537::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:24:56,545::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696927 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:25:04,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`006c5c7f-e168-4036-a384-a2948c7f364d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:25:04,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:25:04,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674281', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696927', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:25:04,928::task::1191::Storage.TaskManager.Task::(prepare) Task=`006c5c7f-e168-4036-a384-a2948c7f364d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674281', 'lastCheck': '8.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696927', 'lastCheck': '8.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:25:04,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`006c5c7f-e168-4036-a384-a2948c7f364d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:25:04,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:25:04,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:25:04,929::task::993::Storage.TaskManager.Task::(_decref) Task=`006c5c7f-e168-4036-a384-a2948c7f364d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:25:06,365::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:25:06,375::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617428 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:25:06,548::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:25:06,556::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583449 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:25:16,377::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:25:16,385::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727271 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:25:16,559::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:25:16,566::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695715 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:25:20,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b08550a-1425-454a-80cd-63094c04b01f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:25:20,036::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:25:20,036::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727271', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695715', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:25:20,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b08550a-1425-454a-80cd-63094c04b01f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727271', 'lastCheck': '3.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695715', 'lastCheck': '3.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:25:20,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b08550a-1425-454a-80cd-63094c04b01f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:25:20,037::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:25:20,037::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:25:20,037::task::993::Storage.TaskManager.Task::(_decref) Task=`6b08550a-1425-454a-80cd-63094c04b01f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:25:26,387::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:25:26,395::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655072 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:25:26,569::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:25:26,577::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712349 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:25:35,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe960a3d-2941-41c6-acd0-724423b470f6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:25:35,152::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:25:35,153::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655072', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712349', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:25:35,153::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe960a3d-2941-41c6-acd0-724423b470f6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655072', 'lastCheck': '8.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712349', 'lastCheck': '8.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:25:35,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe960a3d-2941-41c6-acd0-724423b470f6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:25:35,153::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:25:35,153::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:25:35,153::task::993::Storage.TaskManager.Task::(_decref) Task=`fe960a3d-2941-41c6-acd0-724423b470f6`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:25:36,397::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:25:36,406::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685301 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:25:36,580::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:25:36,588::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0005732 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:25:46,408::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:25:46,417::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00073195 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:25:46,597::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:25:46,604::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653446 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:25:50,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`71a7aee8-b283-4e84-bacc-a7e361dc2071`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:25:50,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:25:50,262::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073195', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653446', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:25:50,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`71a7aee8-b283-4e84-bacc-a7e361dc2071`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00073195', 'lastCheck': '3.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653446', 'lastCheck': '3.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:25:50,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`71a7aee8-b283-4e84-bacc-a7e361dc2071`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:25:50,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:25:50,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:25:50,262::task::993::Storage.TaskManager.Task::(_decref) Task=`71a7aee8-b283-4e84-bacc-a7e361dc2071`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:25:56,418::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:25:56,426::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568002 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:25:56,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:25:56,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702026 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:26:05,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`7321b9f1-3025-4988-b688-3435fa97d604`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:26:05,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:26:05,385::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568002', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702026', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:26:05,385::task::1191::Storage.TaskManager.Task::(prepare) Task=`7321b9f1-3025-4988-b688-3435fa97d604`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568002', 'lastCheck': '9.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702026', 'lastCheck': '8.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:26:05,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`7321b9f1-3025-4988-b688-3435fa97d604`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:26:05,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:26:05,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:26:05,385::task::993::Storage.TaskManager.Task::(_decref) Task=`7321b9f1-3025-4988-b688-3435fa97d604`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:26:06,428::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:26:06,475::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0400713 s, 102 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:26:06,618::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:26:06,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000746367 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:26:16,477::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:26:16,485::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000610164 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:26:16,648::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:26:16,656::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572795 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:26:20,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`aef37a3b-4b4c-447f-b94c-f9011a6728fc`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:26:20,549::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:26:20,550::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610164', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572795', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:26:20,550::task::1191::Storage.TaskManager.Task::(prepare) Task=`aef37a3b-4b4c-447f-b94c-f9011a6728fc`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610164', 'lastCheck': '4.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572795', 'lastCheck': '3.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:26:20,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`aef37a3b-4b4c-447f-b94c-f9011a6728fc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:26:20,550::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:26:20,550::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:26:20,550::task::993::Storage.TaskManager.Task::(_decref) Task=`aef37a3b-4b4c-447f-b94c-f9011a6728fc`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:26:26,487::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:26:26,495::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770974 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:26:26,660::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:26:26,668::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668019 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:26:35,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bc727ec-3bea-4027-b46f-a5d0460f80fd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:26:35,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:26:35,655::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770974', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668019', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:26:35,655::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bc727ec-3bea-4027-b46f-a5d0460f80fd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770974', 'lastCheck': '9.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000668019', 'lastCheck': '9.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:26:35,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bc727ec-3bea-4027-b46f-a5d0460f80fd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:26:35,655::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:26:35,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:26:35,656::task::993::Storage.TaskManager.Task::(_decref) Task=`5bc727ec-3bea-4027-b46f-a5d0460f80fd`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:26:36,497::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:26:36,505::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000668764 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:26:36,671::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:26:36,680::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631615 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:26:46,507::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:26:46,515::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644352 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:26:46,683::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:26:46,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583879 s, 7.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:26:50,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e68a627-32d4-40fc-9f7e-ad095559d74f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:26:50,770::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:26:50,770::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644352', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583879', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:26:50,770::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e68a627-32d4-40fc-9f7e-ad095559d74f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644352', 'lastCheck': '4.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583879', 'lastCheck': '4.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:26:50,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e68a627-32d4-40fc-9f7e-ad095559d74f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:26:50,771::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:26:50,771::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:26:50,771::task::993::Storage.TaskManager.Task::(_decref) Task=`8e68a627-32d4-40fc-9f7e-ad095559d74f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:26:56,517::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:26:56,525::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558487 s, 7.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:26:56,694::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:26:56,703::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737916 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:27:05,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb0a59c0-b5f8-4b52-a7dd-46ffebd74902`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:27:05,875::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:27:05,875::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558487', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737916', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:27:05,875::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb0a59c0-b5f8-4b52-a7dd-46ffebd74902`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558487', 'lastCheck': '9.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737916', 'lastCheck': '9.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:27:05,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb0a59c0-b5f8-4b52-a7dd-46ffebd74902`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:27:05,876::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:27:05,876::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:27:05,876::task::993::Storage.TaskManager.Task::(_decref) Task=`fb0a59c0-b5f8-4b52-a7dd-46ffebd74902`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:27:06,526::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:27:06,535::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625531 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:27:06,706::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:27:06,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063872 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:27:16,537::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:27:16,546::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693713 s, 5.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:27:16,716::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:27:16,724::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616023 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:27:20,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`86fca09b-038c-43e0-95cc-90975f2f15c0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:27:20,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:27:20,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693713', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616023', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:27:20,997::task::1191::Storage.TaskManager.Task::(prepare) Task=`86fca09b-038c-43e0-95cc-90975f2f15c0`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693713', 'lastCheck': '4.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616023', 'lastCheck': '4.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:27:20,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`86fca09b-038c-43e0-95cc-90975f2f15c0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:27:20,998::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:27:20,998::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:27:20,998::task::993::Storage.TaskManager.Task::(_decref) Task=`86fca09b-038c-43e0-95cc-90975f2f15c0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:27:26,547::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:27:26,556::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648361 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:27:26,727::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:27:26,735::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00078847 s, 5.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:27:36,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`7954bbef-4a02-45ec-bd0a-4524446b16a2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:27:36,106::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:27:36,106::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648361', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00078847', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:27:36,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`7954bbef-4a02-45ec-bd0a-4524446b16a2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648361', 'lastCheck': '9.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00078847', 'lastCheck': '9.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:27:36,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`7954bbef-4a02-45ec-bd0a-4524446b16a2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:27:36,106::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:27:36,107::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:27:36,107::task::993::Storage.TaskManager.Task::(_decref) Task=`7954bbef-4a02-45ec-bd0a-4524446b16a2`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:27:36,557::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:27:36,565::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750129 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:27:36,738::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:27:36,747::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000607123 s, 6.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:27:46,567::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:27:46,576::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006686 s, 6.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:27:46,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:27:46,759::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000592805 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:27:51,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`7834fd91-65c1-43e3-bc05-7128ae23f723`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:27:51,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:27:51,238::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006686', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592805', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:27:51,238::task::1191::Storage.TaskManager.Task::(prepare) Task=`7834fd91-65c1-43e3-bc05-7128ae23f723`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006686', 'lastCheck': '4.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592805', 'lastCheck': '4.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:27:51,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`7834fd91-65c1-43e3-bc05-7128ae23f723`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:27:51,238::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:27:51,238::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:27:51,238::task::993::Storage.TaskManager.Task::(_decref) Task=`7834fd91-65c1-43e3-bc05-7128ae23f723`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:27:56,578::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:27:56,586::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784112 s, 5.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:27:56,762::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:27:56,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067578 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:28:06,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`e11af813-37eb-4e5c-a2ea-29d1c87d0644`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:28:06,350::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:28:06,352::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784112', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067578', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:28:06,352::task::1191::Storage.TaskManager.Task::(prepare) Task=`e11af813-37eb-4e5c-a2ea-29d1c87d0644`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784112', 'lastCheck': '9.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067578', 'lastCheck': '9.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:28:06,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`e11af813-37eb-4e5c-a2ea-29d1c87d0644`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:28:06,354::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:28:06,354::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:28:06,355::task::993::Storage.TaskManager.Task::(_decref) Task=`e11af813-37eb-4e5c-a2ea-29d1c87d0644`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:28:06,588::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:28:06,596::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753619 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:28:06,772::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:28:06,781::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633361 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:28:16,598::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:28:16,606::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650335 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:28:16,784::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:28:16,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594459 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:28:21,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8d41184-fe6e-43c5-87ff-c58467b45278`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:28:21,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:28:21,472::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650335', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594459', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:28:21,472::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8d41184-fe6e-43c5-87ff-c58467b45278`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650335', 'lastCheck': '4.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594459', 'lastCheck': '4.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:28:21,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8d41184-fe6e-43c5-87ff-c58467b45278`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:28:21,473::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:28:21,473::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:28:21,473::task::993::Storage.TaskManager.Task::(_decref) Task=`c8d41184-fe6e-43c5-87ff-c58467b45278`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:28:26,608::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:28:26,615::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647144 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:28:26,794::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:28:26,802::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000795508 s, 5.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:28:36,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9cbae05-4816-4b19-9f06-eddb1d154642`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:28:36,582::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:28:36,583::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647144', 'lastCheck': '10.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795508', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:28:36,583::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9cbae05-4816-4b19-9f06-eddb1d154642`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647144', 'lastCheck': '10.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795508', 'lastCheck': '9.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:28:36,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9cbae05-4816-4b19-9f06-eddb1d154642`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:28:36,583::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:28:36,583::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:28:36,584::task::993::Storage.TaskManager.Task::(_decref) Task=`a9cbae05-4816-4b19-9f06-eddb1d154642`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:28:36,617::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:28:36,626::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000752275 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:28:36,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:28:36,813::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000539128 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:28:46,627::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:28:46,639::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648866 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:28:46,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:28:46,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00075999 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:28:51,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`10849857-2669-4de6-ac9c-0e6c191c1350`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:28:51,692::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:28:51,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648866', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075999', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:28:51,692::task::1191::Storage.TaskManager.Task::(prepare) Task=`10849857-2669-4de6-ac9c-0e6c191c1350`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648866', 'lastCheck': '5.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075999', 'lastCheck': '4.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:28:51,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`10849857-2669-4de6-ac9c-0e6c191c1350`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:28:51,693::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:28:51,693::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:28:51,693::task::993::Storage.TaskManager.Task::(_decref) Task=`10849857-2669-4de6-ac9c-0e6c191c1350`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:28:56,642::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:28:56,650::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000539342 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:28:56,830::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:28:56,838::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658335 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:29:06,652::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:29:06,660::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000745743 s, 5.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:29:06,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`e36417ed-33db-4145-8f7d-a262519ef630`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:29:06,806::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:29:06,807::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745743', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658335', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:29:06,807::task::1191::Storage.TaskManager.Task::(prepare) Task=`e36417ed-33db-4145-8f7d-a262519ef630`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745743', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658335', 'lastCheck': '10.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:29:06,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`e36417ed-33db-4145-8f7d-a262519ef630`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:29:06,807::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:29:06,807::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:29:06,808::task::993::Storage.TaskManager.Task::(_decref) Task=`e36417ed-33db-4145-8f7d-a262519ef630`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:29:06,841::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:06,850::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627981 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:29:16,662::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 19:29:16,662::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:29:16,663::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:29:16,671::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00058009 s, 3.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:29:16,671::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00058009 s, 3.5 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:29:16,671::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:29:16,671::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:29:16,672::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:29:16,672::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:29:16,672::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:29:16,672::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:29:16,673::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:29:16,673::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:29:16,673::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:16,856::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 19:29:16,857::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:29:16,857::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:16,865::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00054222 s, 3.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:29:16,866::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00054222 s, 3.8 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 19:29:16,866::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 19:29:16,866::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 19:29:16,866::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:29:16,866::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-16::DEBUG::2014-08-12 19:29:16,929::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:29:16,929::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:29:16,930::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-17::DEBUG::2014-08-12 19:29:16,930::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:29:16,933::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::INFO::2014-08-12 19:29:16,934::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 19:29:16,935::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:29:16,935::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:29:16,935::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:29:16,937::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:16,938::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:29:16,946::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:29:16,946::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:29:17,113::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:29:17,114::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:29:17,123::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000537985 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:29:17,125::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:29:17,126::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:29:17,126::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 19:29:17,127::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 19:29:17,127::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 19:29:17,128::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:29:17,128::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:17,295::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:29:17,296::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:17,304::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618477 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:29:21,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`2093ffa5-1b5b-49eb-bf3e-2efe17f36b34`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:29:21,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:29:21,912::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537985', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618477', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:29:21,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`2093ffa5-1b5b-49eb-bf3e-2efe17f36b34`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537985', 'lastCheck': '4.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618477', 'lastCheck': '4.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:29:21,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`2093ffa5-1b5b-49eb-bf3e-2efe17f36b34`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:29:21,913::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:29:21,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:29:21,913::task::993::Storage.TaskManager.Task::(_decref) Task=`2093ffa5-1b5b-49eb-bf3e-2efe17f36b34`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:29:27,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:29:27,135::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753128 s, 5.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:29:27,308::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:27,315::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657305 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:29:37,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`014584c2-f08a-4014-9dc0-091ba977ee2f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:29:37,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:29:37,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753128', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657305', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:29:37,031::task::1191::Storage.TaskManager.Task::(prepare) Task=`014584c2-f08a-4014-9dc0-091ba977ee2f`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753128', 'lastCheck': '9.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657305', 'lastCheck': '9.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:29:37,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`014584c2-f08a-4014-9dc0-091ba977ee2f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:29:37,032::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:29:37,032::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:29:37,032::task::993::Storage.TaskManager.Task::(_decref) Task=`014584c2-f08a-4014-9dc0-091ba977ee2f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:29:37,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:29:37,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750662 s, 5.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:29:37,318::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:37,326::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575392 s, 7.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:29:47,149::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:29:47,158::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622034 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:29:47,329::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:47,341::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647212 s, 6.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:29:52,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9055ca0-0da3-4601-a5a6-c4fc176fa182`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:29:52,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:29:52,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622034', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647212', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:29:52,147::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9055ca0-0da3-4601-a5a6-c4fc176fa182`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622034', 'lastCheck': '5.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647212', 'lastCheck': '4.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:29:52,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9055ca0-0da3-4601-a5a6-c4fc176fa182`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:29:52,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:29:52,148::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:29:52,148::task::993::Storage.TaskManager.Task::(_decref) Task=`d9055ca0-0da3-4601-a5a6-c4fc176fa182`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:29:57,160::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:29:57,168::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000552622 s, 7.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:29:57,345::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:29:57,353::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693327 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:30:07,170::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:30:07,178::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719396 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:30:07,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9284724-383a-409a-9d7a-2efea478c3b4`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:30:07,260::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:30:07,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719396', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693327', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:30:07,261::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9284724-383a-409a-9d7a-2efea478c3b4`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000719396', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693327', 'lastCheck': '9.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:30:07,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9284724-383a-409a-9d7a-2efea478c3b4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:30:07,261::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:30:07,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:30:07,261::task::993::Storage.TaskManager.Task::(_decref) Task=`a9284724-383a-409a-9d7a-2efea478c3b4`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:30:07,357::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:30:07,366::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718417 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:30:17,180::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:30:17,188::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000589028 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:30:17,369::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:30:17,376::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061024 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:30:22,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf4f18b2-8894-4e41-b019-13bb4a1e9330`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:30:22,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:30:22,375::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589028', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061024', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:30:22,375::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf4f18b2-8894-4e41-b019-13bb4a1e9330`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589028', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061024', 'lastCheck': '5.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:30:22,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf4f18b2-8894-4e41-b019-13bb4a1e9330`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:30:22,376::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:30:22,377::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:30:22,377::task::993::Storage.TaskManager.Task::(_decref) Task=`cf4f18b2-8894-4e41-b019-13bb4a1e9330`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:30:27,190::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:30:27,199::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061952 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:30:27,379::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:30:27,388::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000536407 s, 7.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:30:37,201::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:30:37,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067739 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:30:37,391::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:30:37,398::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568068 s, 7.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:30:37,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`32f2f545-504d-4b06-b91f-9ac33e949e66`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:30:37,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:30:37,496::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067739', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568068', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:30:37,496::task::1191::Storage.TaskManager.Task::(prepare) Task=`32f2f545-504d-4b06-b91f-9ac33e949e66`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067739', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568068', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:30:37,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`32f2f545-504d-4b06-b91f-9ac33e949e66`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:30:37,496::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:30:37,496::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:30:37,496::task::993::Storage.TaskManager.Task::(_decref) Task=`32f2f545-504d-4b06-b91f-9ac33e949e66`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:30:40,940::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [48801522] >Thread-15::DEBUG::2014-08-12 19:30:40,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`12c1db25-0d33-43f2-9323-a4605d99ca5f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:30:40,940::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}], options=None) >Thread-15::DEBUG::2014-08-12 19:30:40,942::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-15::DEBUG::2014-08-12 19:30:40,944::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01 /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-29::DEBUG::2014-08-12 19:30:41,004::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-29::DEBUG::2014-08-12 19:30:41,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:30:41,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:30:41,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:30:41,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:30:41,005::__init__::225::IOProcess::(_processLogs) (492) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:30:41,006::__init__::225::IOProcess::(_processLogs) (492) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:30:41,006::__init__::225::IOProcess::(_processLogs) (492) Queuing response >Thread-29::DEBUG::2014-08-12 19:30:41,007::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-15::DEBUG::2014-08-12 19:30:41,029::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:30:41,030::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:30:41,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:30:41,030::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:30:41,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:30:41,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:30:41,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:30:41,031::__init__::225::IOProcess::(_processLogs) (493) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:30:41,031::__init__::225::IOProcess::(_processLogs) (493) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 19:30:41,031::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0f3b75de-d8cd-4073-a764-8762b9b6cb75',) >Thread-29::DEBUG::2014-08-12 19:30:41,032::__init__::225::IOProcess::(_processLogs) (493) Queuing response >Thread-15::DEBUG::2014-08-12 19:30:41,032::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {875dcd61-503b-4d05-aaea-576145a41424: storage.nfsSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 0f3b75de-d8cd-4073-a764-8762b9b6cb75: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, b6cdb3e0-8d34-4a62-b549-b76d054a4386: storage.nfsSD.findDomain} >Thread-15::INFO::2014-08-12 19:30:41,033::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}]} >Thread-29::DEBUG::2014-08-12 19:30:41,033::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:30:41,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`12c1db25-0d33-43f2-9323-a4605d99ca5f`::finished: {'statuslist': [{'status': 0, 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}]} >Thread-15::DEBUG::2014-08-12 19:30:41,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`12c1db25-0d33-43f2-9323-a4605d99ca5f`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 19:30:41,035::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 19:30:41,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:30:41,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:30:41,037::task::993::Storage.TaskManager.Task::(_decref) Task=`12c1db25-0d33-43f2-9323-a4605d99ca5f`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:30:47,210::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:30:47,219::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734219 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:30:47,401::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:30:47,408::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667628 s, 6.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:30:52,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d36ba37-ee65-4db2-9a91-6b755b2ec26d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:30:52,608::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:30:52,609::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734219', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667628', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:30:52,610::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d36ba37-ee65-4db2-9a91-6b755b2ec26d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734219', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667628', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:30:52,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d36ba37-ee65-4db2-9a91-6b755b2ec26d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:30:52,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:30:52,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:30:52,612::task::993::Storage.TaskManager.Task::(_decref) Task=`4d36ba37-ee65-4db2-9a91-6b755b2ec26d`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:30:57,221::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:30:57,229::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00053825 s, 7.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:30:57,411::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:30:57,419::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712692 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:06,040::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [6b9d442] >Thread-15::DEBUG::2014-08-12 19:31:06,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8d0380e-e090-4bf6-b218-845380060744`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:31:06,041::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}], options=None) >Thread-15::DEBUG::2014-08-12 19:31:06,043::hsm::2366::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 >Thread-29::DEBUG::2014-08-12 19:31:06,044::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:06,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:06,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:06,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:06,044::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:06,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:06,045::__init__::225::IOProcess::(_processLogs) (494) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:31:06,045::__init__::225::IOProcess::(_processLogs) (494) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:31:06,045::__init__::225::IOProcess::(_processLogs) DEBUG|(494) Building response >Thread-15::DEBUG::2014-08-12 19:31:06,046::hsm::2390::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'0f3b75de-d8cd-4073-a764-8762b9b6cb75',) >Thread-15::DEBUG::2014-08-12 19:31:06,046::hsm::2446::Storage.HSM::(connectStorageServer) knownSDs: {875dcd61-503b-4d05-aaea-576145a41424: storage.nfsSD.findDomain, 0adb6530-ef5f-41f0-8655-a7ca83123c87: storage.nfsSD.findDomain, 68d897e0-6b30-4609-a78d-cdb2c1411233: storage.nfsSD.findDomain, 0f3b75de-d8cd-4073-a764-8762b9b6cb75: storage.nfsSD.findDomain, 880b1e00-85c8-4296-8d02-a32c1d378a1f: storage.nfsSD.findDomain, 180aea8f-26ba-4e87-8a94-37d5469519bf: storage.blockSD.findDomain, a217cac4-c442-4af7-9502-bfc17ca3271c: storage.blockSD.findDomain, b6cdb3e0-8d34-4a62-b549-b76d054a4386: storage.nfsSD.findDomain} >Thread-29::DEBUG::2014-08-12 19:31:06,046::__init__::225::IOProcess::(_processLogs) (494) Queuing response >Thread-15::INFO::2014-08-12 19:31:06,047::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}]} >Thread-29::DEBUG::2014-08-12 19:31:06,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:31:06,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8d0380e-e090-4bf6-b218-845380060744`::finished: {'statuslist': [{'status': 0, 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}]} >Thread-15::DEBUG::2014-08-12 19:31:06,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8d0380e-e090-4bf6-b218-845380060744`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-08-12 19:31:06,048::__init__::225::IOProcess::(_processLogs) Sending response sized 192 >Thread-15::DEBUG::2014-08-12 19:31:06,049::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:31:06,050::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:31:06,050::task::993::Storage.TaskManager.Task::(_decref) Task=`c8d0380e-e090-4bf6-b218-845380060744`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:31:06,286::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 19:31:06,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`518c7565-3a54-426a-9077-f7774e601cb0`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:31:06,286::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'0f3b75de-d8cd-4073-a764-8762b9b6cb75': 'active', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 19:31:06,287::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`e7eaf8ac-3d3e-41e4-87d9-fa82b1549e56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 19:31:06,287::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 19:31:06,287::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 19:31:06,287::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`e7eaf8ac-3d3e-41e4-87d9-fa82b1549e56`::Granted request >Thread-15::DEBUG::2014-08-12 19:31:06,288::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`183e5893-7e37-489e-a869-08cea8a66c20`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 19:31:06,288::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 19:31:06,288::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 19:31:06,288::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`183e5893-7e37-489e-a869-08cea8a66c20`::Granted request >Thread-15::DEBUG::2014-08-12 19:31:06,289::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': 'active', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 19:31:06,289::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': 'Active', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::DEBUG::2014-08-12 19:31:06,289::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,290::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,290::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,290::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,290::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,290::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,291::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:31:06,291::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:31:06,291::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:31:06,291::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:31:06,291::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:31:06,292::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:31:06,334::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:31:06,335::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:31:06,448::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:06,449::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,449::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,449::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,449::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,449::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,450::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,450::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:31:06,450::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,453::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 19:31:06,663::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:06,663::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,664::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 19:31:06,664::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 19:31:06,673::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000496211 s, 4.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:06,673::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000496211 s, 4.1 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 19:31:06,673::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 19:31:06,673::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 19:31:06,674::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 19:31:06,674::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,674::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,674::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,675::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,675::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,675::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 19:31:06,851::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:06,852::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:06,852::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 19:31:06,853::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 19:31:06,853::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 19:31:06,853::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 19:31:06,853::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 19:31:06,854::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 19:31:06,854::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 19:31:06,854::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 0f3b75de-d8cd-4073-a764-8762b9b6cb75 >Thread-15::DEBUG::2014-08-12 19:31:06,855::sp::1410::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` started monitoring domain `0f3b75de-d8cd-4073-a764-8762b9b6cb75` >Thread-82::DEBUG::2014-08-12 19:31:06,855::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 0f3b75de-d8cd-4073-a764-8762b9b6cb75 >Thread-15::DEBUG::2014-08-12 19:31:06,856::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:31:06,857::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 19:31:06,859::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 19:31:06,861::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-29::DEBUG::2014-08-12 19:31:06,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-15::DEBUG::2014-08-12 19:31:06,862::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 0f3b75de-d8cd-4073-a764-8762b9b6cb75 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-29::DEBUG::2014-08-12 19:31:06,863::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:31:06,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:06,871::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:06,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:06,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:06,872::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:06,872::__init__::225::IOProcess::(_processLogs) (495) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:31:06,873::__init__::225::IOProcess::(_processLogs) (495) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:31:06,873::__init__::225::IOProcess::(_processLogs) (495) Building response >Thread-29::DEBUG::2014-08-12 19:31:06,873::__init__::225::IOProcess::(_processLogs) (495) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:06,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:06,874::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-82::DEBUG::2014-08-12 19:31:06,878::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75 >Thread-29::DEBUG::2014-08-12 19:31:06,879::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:06,879::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:31:06,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:06,880::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:06,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:06,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:06,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:06,880::__init__::225::IOProcess::(_processLogs) (496) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:31:06,880::__init__::225::IOProcess::(_processLogs) (496) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:31:06,881::__init__::225::IOProcess::(_processLogs) DEBUG|(496) Building response >Thread-82::DEBUG::2014-08-12 19:31:06,881::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:31:06,882::__init__::225::IOProcess::(_processLogs) (496) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:06,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:06,882::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:31:06,883::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:06,883::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:31:06,883::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:06,883::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:06,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:06,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:06,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:06,884::__init__::225::IOProcess::(_processLogs) (497) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:31:06,884::__init__::225::IOProcess::(_processLogs) (497) Got request for method 'readfile' >Thread-82::DEBUG::2014-08-12 19:31:06,884::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=adf', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0f3b75de-d8cd-4073-a764-8762b9b6cb75', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf9cab8cb78003072553cd4116b325ef6d75f836'] >Thread-29::DEBUG::2014-08-12 19:31:06,884::__init__::225::IOProcess::(_processLogs) DEBUG|(497) Building response >Thread-29::DEBUG::2014-08-12 19:31:06,885::__init__::225::IOProcess::(_processLogs) (497) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:06,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:06,886::__init__::225::IOProcess::(_processLogs) Sending response sized 539 >Thread-29::DEBUG::2014-08-12 19:31:06,886::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:06,887::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 19:31:06,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:06,887::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:06,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:06,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:06,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:06,888::__init__::225::IOProcess::(_processLogs) (498) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:31:06,888::__init__::225::IOProcess::(_processLogs) (498) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:31:06,888::__init__::225::IOProcess::(_processLogs) (498) Building response >Thread-29::DEBUG::2014-08-12 19:31:06,888::__init__::225::IOProcess::(_processLogs) (498) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:06,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:06,889::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:31:06,889::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:06,889::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 19:31:06,889::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:06,889::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:06,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:06,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:06,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:06,890::__init__::225::IOProcess::(_processLogs) (499) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:31:06,890::__init__::225::IOProcess::(_processLogs) (499) Got request for method 'glob' >Thread-82::DEBUG::2014-08-12 19:31:06,891::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 19:31:06,891::__init__::225::IOProcess::(_processLogs) DEBUG|(499) Building response >Thread-82::DEBUG::2014-08-12 19:31:06,892::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '0f3b75de-d8cd-4073-a764-8762b9b6cb75_imageNS' >Thread-29::DEBUG::2014-08-12 19:31:06,892::__init__::225::IOProcess::(_processLogs) (499) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:06,893::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-82::DEBUG::2014-08-12 19:31:06,893::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '0f3b75de-d8cd-4073-a764-8762b9b6cb75_volumeNS' >Thread-29::DEBUG::2014-08-12 19:31:06,893::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-29::DEBUG::2014-08-12 19:31:06,894::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:06,894::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:06,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:06,895::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:06,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:06,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:06,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:06,895::__init__::225::IOProcess::(_processLogs) (500) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:06,895::__init__::225::IOProcess::(_processLogs) (500) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:06,896::__init__::225::IOProcess::(_processLogs) DEBUG|(500) Building response >Thread-82::DEBUG::2014-08-12 19:31:06,897::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:31:06,897::__init__::225::IOProcess::(_processLogs) (500) Queuing response >Thread-82::DEBUG::2014-08-12 19:31:06,907::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000273172 s, 1.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:31:06,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:06,908::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:31:06,908::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:06,908::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:06,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:06,909::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:06,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-82::DEBUG::2014-08-12 19:31:06,910::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 0f3b75de-d8cd-4073-a764-8762b9b6cb75 changed its status to Valid >Thread-29::DEBUG::2014-08-12 19:31:06,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-82::INFO::2014-08-12 19:31:06,911::clusterlock::183::Storage.SANLock::(acquireHostId) Acquiring host id for domain 0f3b75de-d8cd-4073-a764-8762b9b6cb75 (id: 1) >Thread-84::DEBUG::2014-08-12 19:31:06,911::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-29::DEBUG::2014-08-12 19:31:06,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-82::DEBUG::2014-08-12 19:31:06,913::clusterlock::201::Storage.SANLock::(acquireHostId) Host id for domain 0f3b75de-d8cd-4073-a764-8762b9b6cb75 successfully acquired (id: 1) >Thread-84::DEBUG::2014-08-12 19:31:06,913::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-29::DEBUG::2014-08-12 19:31:06,914::__init__::225::IOProcess::(_processLogs) (501) Finding callback 'statvfs'... >Thread-84::DEBUG::2014-08-12 19:31:06,915::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-29::DEBUG::2014-08-12 19:31:06,916::__init__::225::IOProcess::(_processLogs) (501) Got request for method 'statvfs' >Thread-85::INFO::2014-08-12 19:31:06,916::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >Thread-29::DEBUG::2014-08-12 19:31:06,917::__init__::225::IOProcess::(_processLogs) (501) Building response >Thread-29::DEBUG::2014-08-12 19:31:06,917::__init__::225::IOProcess::(_processLogs) (501) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:06,918::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:06,918::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-15::DEBUG::2014-08-12 19:31:07,059::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "0f3b75de-d8cd-4073-a764-8762b9b6cb75" not found\n Skipping volume group 0f3b75de-d8cd-4073-a764-8762b9b6cb75\n'; <rc> = 5 >Thread-15::WARNING::2014-08-12 19:31:07,067::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [' DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc|180aea8f-26ba-4e87-8a94-37d5469519bf|wz--n-|42547019776|22011707392|134217728|317|164|MDT_LEASETIMESEC=60,MDT_VERSION=3,MDT_TYPE=ISCSI,MDT_SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf,MDT_PV0=pv:3600601601282300060dddcba33f2e311&44&uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP&44&pestart:0&44&pecount:317&44&mapoffset:0,MDT_LEASERETRIES=3,MDT_IOOPTIMEOUTSEC=10,MDT_LOCKRENEWALINTERVALSEC=5,MDT_LOCKPOLICY=,MDT_ROLE=Regular,MDT_PHYBLKSIZE=512,MDT_LOGBLKSIZE=512,MDT_VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc,MDT_CLASS=Data,MDT_DESCRIPTION=iscsi_1,RHAT_storage_domain,MDT_POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a,MDT__SHA_CKSUM=189d056969591a327adf4c729525fafb366effde|134217728|67100160|15|1|/dev/mapper/3600601601282300060dddcba33f2e311'] [' Volume group "0f3b75de-d8cd-4073-a764-8762b9b6cb75" not found', ' Skipping volume group 0f3b75de-d8cd-4073-a764-8762b9b6cb75'] >Thread-15::DEBUG::2014-08-12 19:31:07,068::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:31:07,069::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 19:31:07,069::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 19:31:07,070::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 19:31:07,071::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 19:31:07,075::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:07,076::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:31:07,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:07,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:07,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:07,079::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:07,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:07,082::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(502) Finding callback 'glob'... >Thread-15::INFO::2014-08-12 19:31:07,084::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/0f3b75de-d8cd-4073-a764-8762b9b6cb75 >Thread-29::DEBUG::2014-08-12 19:31:07,085::__init__::225::IOProcess::(_processLogs) (502) Got request for method 'glob' >Thread-15::DEBUG::2014-08-12 19:31:07,086::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75 to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/0f3b75de-d8cd-4073-a764-8762b9b6cb75 >Thread-29::DEBUG::2014-08-12 19:31:07,087::__init__::225::IOProcess::(_processLogs) (502) Building response >Thread-15::INFO::2014-08-12 19:31:07,088::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 19:31:07,090::__init__::225::IOProcess::(_processLogs) (502) Queuing response >Thread-15::DEBUG::2014-08-12 19:31:07,090::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 19:31:07,092::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-15::DEBUG::2014-08-12 19:31:07,093::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 19:31:07,095::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-29::DEBUG::2014-08-12 19:31:07,095::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 19:31:07,096::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 19:31:07,098::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 19:31:07,099::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 19:31:07,099::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 19:31:07,100::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 19:31:07,101::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 19:31:07,101::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 19:31:07,102::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 19:31:07,102::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:31:07,103::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 19:31:07,104::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 19:31:07,104::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 19:31:07,105::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:31:07,105::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 19:31:07,106::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 19:31:07,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`518c7565-3a54-426a-9077-f7774e601cb0`::finished: True >Thread-15::DEBUG::2014-08-12 19:31:07,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`518c7565-3a54-426a-9077-f7774e601cb0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:31:07,107::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:31:07,108::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:31:07,108::task::993::Storage.TaskManager.Task::(_decref) Task=`518c7565-3a54-426a-9077-f7774e601cb0`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:31:07,230::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:31:07,231::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:07,238::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000669738 s, 3.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:31:07,239::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000669738 s, 3.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:31:07,239::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:31:07,239::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:31:07,239::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:31:07,240::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:31:07,240::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:31:07,240::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:31:07,240::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:31:07,241::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:31:07,241::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:07,424::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:31:07,426::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:07,426::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:31:07,435::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 19:31:07,437::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 19:31:07,437::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:31:07,437::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 19:31:07,437::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:31:07,596::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:31:07,597::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:07,606::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:31:07,607::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000587112 s, 7.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:31:07,608::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:07,620::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626107 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:07,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f25e949-be02-4820-b3e2-fcc13213ccbb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:31:07,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:31:07,742::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000273172', 'lastCheck': '0.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626107', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587112', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:31:07,742::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f25e949-be02-4820-b3e2-fcc13213ccbb`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000273172', 'lastCheck': '0.8', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626107', 'lastCheck': '0.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587112', 'lastCheck': '0.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:31:07,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f25e949-be02-4820-b3e2-fcc13213ccbb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:31:07,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:31:07,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:31:07,742::task::993::Storage.TaskManager.Task::(_decref) Task=`7f25e949-be02-4820-b3e2-fcc13213ccbb`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:31:16,915::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:16,916::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:16,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:16,916::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:16,916::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:16,917::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:16,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:16,917::__init__::225::IOProcess::(_processLogs) (503) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:16,917::__init__::225::IOProcess::(_processLogs) (503) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:16,918::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(503) Building response >Thread-29::DEBUG::2014-08-12 19:31:16,919::__init__::225::IOProcess::(_processLogs) (503) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:16,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-82::DEBUG::2014-08-12 19:31:16,921::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:31:16,921::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:31:16,932::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.00043718 s, 803 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:31:16,933::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:16,934::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:16,934::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:16,935::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:16,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:16,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:16,937::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:16,937::__init__::225::IOProcess::(_processLogs) (504) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:16,938::__init__::225::IOProcess::(_processLogs) (504) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:16,938::__init__::225::IOProcess::(_processLogs) (504) Building response >Thread-29::DEBUG::2014-08-12 19:31:16,938::__init__::225::IOProcess::(_processLogs) (504) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:16,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:16,938::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:31:17,624::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:17,634::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072288 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:31:17,635::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:31:17,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000524134 s, 7.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:22,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`98032dd1-f63c-4b78-ae9c-9bf32d1f84cb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:31:22,857::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:31:22,858::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00043718', 'lastCheck': '5.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072288', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524134', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:31:22,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`98032dd1-f63c-4b78-ae9c-9bf32d1f84cb`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00043718', 'lastCheck': '5.9', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072288', 'lastCheck': '5.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524134', 'lastCheck': '5.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:31:22,859::task::595::Storage.TaskManager.Task::(_updateState) Task=`98032dd1-f63c-4b78-ae9c-9bf32d1f84cb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:31:22,859::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:31:22,860::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:31:22,860::task::993::Storage.TaskManager.Task::(_decref) Task=`98032dd1-f63c-4b78-ae9c-9bf32d1f84cb`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:31:26,939::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:26,939::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:26,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:26,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:26,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:26,940::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:26,940::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:26,941::__init__::225::IOProcess::(_processLogs) (505) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:26,941::__init__::225::IOProcess::(_processLogs) (505) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:26,941::__init__::225::IOProcess::(_processLogs) (505) Building response >Thread-29::DEBUG::2014-08-12 19:31:26,941::__init__::225::IOProcess::(_processLogs) (505) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:26,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:26,943::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:31:26,943::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-82::DEBUG::2014-08-12 19:31:26,952::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000306525 s, 1.1 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:31:26,953::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:26,953::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:26,954::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:26,954::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:26,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:26,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:26,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:26,956::__init__::225::IOProcess::(_processLogs) (506) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:26,956::__init__::225::IOProcess::(_processLogs) (506) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:26,956::__init__::225::IOProcess::(_processLogs) (506) Building response >Thread-29::DEBUG::2014-08-12 19:31:26,956::__init__::225::IOProcess::(_processLogs) (506) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:26,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:26,957::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:31:27,644::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:27,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651168 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:31:27,654::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:31:27,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000666657 s, 6.1 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:31:36,956::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:36,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:36,957::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:36,957::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:36,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:36,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:36,957::__init__::225::IOProcess::(_processLogs) (507) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:36,958::__init__::225::IOProcess::(_processLogs) (507) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:36,959::__init__::225::IOProcess::(_processLogs) (507) Queuing response >Thread-82::DEBUG::2014-08-12 19:31:36,959::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:31:36,960::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:36,968::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:31:36,970::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000739722 s, 475 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:31:36,971::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:36,971::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:36,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:36,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:36,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:36,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:36,973::__init__::225::IOProcess::(_processLogs) (508) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:36,974::__init__::225::IOProcess::(_processLogs) (508) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:36,974::__init__::225::IOProcess::(_processLogs) (508) Building response >Thread-29::DEBUG::2014-08-12 19:31:36,974::__init__::225::IOProcess::(_processLogs) (508) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:36,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:36,974::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:31:37,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:31:37,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:37,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571198 s, 7.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:31:37,686::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000529028 s, 7.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:37,992::task::595::Storage.TaskManager.Task::(_updateState) Task=`64c92f41-1655-48ae-b823-9f23c1671c4b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:31:37,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:31:38,009::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739722', 'lastCheck': '1.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571198', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529028', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:31:38,009::task::1191::Storage.TaskManager.Task::(prepare) Task=`64c92f41-1655-48ae-b823-9f23c1671c4b`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739722', 'lastCheck': '1.0', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571198', 'lastCheck': '0.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529028', 'lastCheck': '0.3', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:31:38,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`64c92f41-1655-48ae-b823-9f23c1671c4b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:31:38,009::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:31:38,009::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:31:38,009::task::993::Storage.TaskManager.Task::(_decref) Task=`64c92f41-1655-48ae-b823-9f23c1671c4b`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:31:46,974::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:46,974::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:46,975::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:46,975::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:46,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:46,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:46,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:46,975::__init__::225::IOProcess::(_processLogs) (509) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:46,975::__init__::225::IOProcess::(_processLogs) (509) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:46,976::__init__::225::IOProcess::(_processLogs) DEBUG|(509) Building response >Thread-29::DEBUG::2014-08-12 19:31:46,977::__init__::225::IOProcess::(_processLogs) (509) Queuing response >Thread-82::DEBUG::2014-08-12 19:31:46,977::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:31:46,978::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:46,986::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:31:46,986::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000409848 s, 856 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:31:46,987::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:46,988::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:46,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:46,989::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:46,989::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:46,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:46,990::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:46,990::__init__::225::IOProcess::(_processLogs) (510) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:46,990::__init__::225::IOProcess::(_processLogs) (510) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:46,990::__init__::225::IOProcess::(_processLogs) (510) Building response >Thread-29::DEBUG::2014-08-12 19:31:46,991::__init__::225::IOProcess::(_processLogs) (510) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:46,991::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:46,991::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:31:47,688::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:47,697::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656037 s, 6.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:31:47,697::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:31:47,705::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615605 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:31:53,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`97a83b25-fe74-4a2b-85a1-8b654ccb41a8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:31:53,120::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:31:53,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409848', 'lastCheck': '6.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656037', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615605', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:31:53,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`97a83b25-fe74-4a2b-85a1-8b654ccb41a8`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409848', 'lastCheck': '6.1', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656037', 'lastCheck': '5.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000615605', 'lastCheck': '5.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:31:53,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`97a83b25-fe74-4a2b-85a1-8b654ccb41a8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:31:53,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:31:53,124::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:31:53,125::task::993::Storage.TaskManager.Task::(_decref) Task=`97a83b25-fe74-4a2b-85a1-8b654ccb41a8`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:31:56,991::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:56,991::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:56,991::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:56,992::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:56,992::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:56,992::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:56,992::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:56,992::__init__::225::IOProcess::(_processLogs) (511) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:56,992::__init__::225::IOProcess::(_processLogs) (511) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:56,993::__init__::225::IOProcess::(_processLogs) (511) Building response >Thread-29::DEBUG::2014-08-12 19:31:56,993::__init__::225::IOProcess::(_processLogs) (511) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:56,993::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:31:56,994::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:31:56,994::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-82::DEBUG::2014-08-12 19:31:57,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000551042 s, 637 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:31:57,004::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:31:57,004::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:31:57,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:31:57,004::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:31:57,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:31:57,004::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:31:57,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:31:57,005::__init__::225::IOProcess::(_processLogs) (512) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:31:57,005::__init__::225::IOProcess::(_processLogs) (512) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:31:57,005::__init__::225::IOProcess::(_processLogs) (512) Building response >Thread-29::DEBUG::2014-08-12 19:31:57,005::__init__::225::IOProcess::(_processLogs) (512) Queuing response >Thread-29::DEBUG::2014-08-12 19:31:57,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:31:57,006::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:31:57,706::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:31:57,714::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:31:57,715::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721744 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:31:57,724::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664108 s, 6.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:32:07,008::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:07,008::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:07,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:07,031::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:07,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-82::DEBUG::2014-08-12 19:32:07,032::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:32:07,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:07,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:07,040::__init__::225::IOProcess::(_processLogs) (513) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:07,041::__init__::225::IOProcess::(_processLogs) (513) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:07,041::__init__::225::IOProcess::(_processLogs) (513) Building response >Thread-82::DEBUG::2014-08-12 19:32:07,042::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000351405 s, 999 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:32:07,042::__init__::225::IOProcess::(_processLogs) (513) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:07,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:07,043::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:32:07,043::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:07,043::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:07,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:07,044::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:07,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:07,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:07,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:07,046::__init__::225::IOProcess::(_processLogs) (514) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:07,046::__init__::225::IOProcess::(_processLogs) (514) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:07,046::__init__::225::IOProcess::(_processLogs) (514) Building response >Thread-29::DEBUG::2014-08-12 19:32:07,046::__init__::225::IOProcess::(_processLogs) (514) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:07,047::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:07,047::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:32:07,725::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:32:07,735::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:32:07,736::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582793 s, 7.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:32:07,746::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602104 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:32:08,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`15dcfe89-fa5a-4bba-96a3-9b80515ffc08`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:32:08,251::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:32:08,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351405', 'lastCheck': '1.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582793', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602104', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:32:08,251::task::1191::Storage.TaskManager.Task::(prepare) Task=`15dcfe89-fa5a-4bba-96a3-9b80515ffc08`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351405', 'lastCheck': '1.2', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582793', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602104', 'lastCheck': '0.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:32:08,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`15dcfe89-fa5a-4bba-96a3-9b80515ffc08`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:32:08,251::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:32:08,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:32:08,252::task::993::Storage.TaskManager.Task::(_decref) Task=`15dcfe89-fa5a-4bba-96a3-9b80515ffc08`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:32:17,047::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:17,047::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:17,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:17,047::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:17,047::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:17,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:17,048::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:17,048::__init__::225::IOProcess::(_processLogs) (515) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:17,048::__init__::225::IOProcess::(_processLogs) (515) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:17,049::__init__::225::IOProcess::(_processLogs) DEBUG|(515) Building response >Thread-29::DEBUG::2014-08-12 19:32:17,049::__init__::225::IOProcess::(_processLogs) (515) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:17,050::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:32:17,050::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:32:17,051::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-82::DEBUG::2014-08-12 19:32:17,059::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000435246 s, 806 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:32:17,060::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:17,060::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:17,060::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:17,061::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:17,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:17,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:17,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:17,063::__init__::225::IOProcess::(_processLogs) (516) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:17,063::__init__::225::IOProcess::(_processLogs) (516) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:17,063::__init__::225::IOProcess::(_processLogs) (516) Building response >Thread-29::DEBUG::2014-08-12 19:32:17,063::__init__::225::IOProcess::(_processLogs) (516) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:17,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:17,064::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:32:17,747::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:32:17,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631592 s, 6.5 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:32:17,756::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:32:17,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000574824 s, 7.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:32:23,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`28e7d1f0-eb64-4ca5-8bc3-8e6e79effb1f`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:32:23,363::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:32:23,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435246', 'lastCheck': '6.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631592', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574824', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:32:23,363::task::1191::Storage.TaskManager.Task::(prepare) Task=`28e7d1f0-eb64-4ca5-8bc3-8e6e79effb1f`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435246', 'lastCheck': '6.3', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631592', 'lastCheck': '5.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000574824', 'lastCheck': '5.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:32:23,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`28e7d1f0-eb64-4ca5-8bc3-8e6e79effb1f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:32:23,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:32:23,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:32:23,364::task::993::Storage.TaskManager.Task::(_decref) Task=`28e7d1f0-eb64-4ca5-8bc3-8e6e79effb1f`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:32:27,063::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:27,064::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:27,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:27,065::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:27,066::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-82::DEBUG::2014-08-12 19:32:27,066::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:32:27,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:27,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:27,075::__init__::225::IOProcess::(_processLogs) (517) Finding callback 'statvfs'... >Thread-82::DEBUG::2014-08-12 19:32:27,076::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000418341 s, 839 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:32:27,077::__init__::225::IOProcess::(_processLogs) (517) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:27,078::__init__::225::IOProcess::(_processLogs) (517) Building response >Thread-29::DEBUG::2014-08-12 19:32:27,078::__init__::225::IOProcess::(_processLogs) (517) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:27,078::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:27,079::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:32:27,079::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:27,079::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:27,079::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:27,079::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:27,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:27,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:27,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:27,080::__init__::225::IOProcess::(_processLogs) (518) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:27,080::__init__::225::IOProcess::(_processLogs) (518) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:27,081::__init__::225::IOProcess::(_processLogs) DEBUG|(518) Building response >Thread-29::DEBUG::2014-08-12 19:32:27,082::__init__::225::IOProcess::(_processLogs) (518) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:27,082::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:27,083::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:32:27,765::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:32:27,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:32:27,773::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729735 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:32:27,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000728983 s, 5.6 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:32:37,084::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:37,084::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:37,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:37,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:37,086::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:37,086::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-82::DEBUG::2014-08-12 19:32:37,086::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:32:37,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:37,095::__init__::225::IOProcess::(_processLogs) (519) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:37,095::__init__::225::IOProcess::(_processLogs) (519) Got request for method 'statvfs' >Thread-82::DEBUG::2014-08-12 19:32:37,096::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000300216 s, 1.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:32:37,096::__init__::225::IOProcess::(_processLogs) (519) Building response >Thread-29::DEBUG::2014-08-12 19:32:37,097::__init__::225::IOProcess::(_processLogs) (519) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:37,097::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:37,097::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:32:37,097::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:37,098::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:37,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:37,099::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:37,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:37,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:37,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:37,101::__init__::225::IOProcess::(_processLogs) (520) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:37,101::__init__::225::IOProcess::(_processLogs) (520) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:37,101::__init__::225::IOProcess::(_processLogs) (520) Building response >Thread-29::DEBUG::2014-08-12 19:32:37,101::__init__::225::IOProcess::(_processLogs) (520) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:37,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:37,102::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:32:37,783::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:32:37,792::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598169 s, 6.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:32:37,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:32:37,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000506753 s, 8.1 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:32:38,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`df4903e8-8d99-4c23-aa4b-565d206601bb`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:32:38,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:32:38,474::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300216', 'lastCheck': '1.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598169', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506753', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:32:38,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`df4903e8-8d99-4c23-aa4b-565d206601bb`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300216', 'lastCheck': '1.4', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598169', 'lastCheck': '0.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506753', 'lastCheck': '0.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:32:38,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`df4903e8-8d99-4c23-aa4b-565d206601bb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:32:38,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:32:38,475::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:32:38,475::task::993::Storage.TaskManager.Task::(_decref) Task=`df4903e8-8d99-4c23-aa4b-565d206601bb`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:32:47,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:47,102::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:47,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:47,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:47,102::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:47,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:47,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:47,103::__init__::225::IOProcess::(_processLogs) (521) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:47,103::__init__::225::IOProcess::(_processLogs) (521) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:47,103::__init__::225::IOProcess::(_processLogs) DEBUG|(521) Building response >Thread-29::DEBUG::2014-08-12 19:32:47,103::__init__::225::IOProcess::(_processLogs) (521) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:47,104::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:32:47,105::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:32:47,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-82::DEBUG::2014-08-12 19:32:47,116::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000968362 s, 362 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:32:47,117::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:47,117::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:47,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:47,117::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:47,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:47,118::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:47,118::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:47,118::__init__::225::IOProcess::(_processLogs) (522) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:47,118::__init__::225::IOProcess::(_processLogs) (522) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:47,118::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(522) Building response >Thread-29::DEBUG::2014-08-12 19:32:47,119::__init__::225::IOProcess::(_processLogs) (522) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:47,120::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:47,121::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:32:47,800::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:32:47,809::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:32:47,809::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617155 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:32:47,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609588 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:32:53,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a80cdf1-a8a2-46e9-91a6-1f91f0bee2a8`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:32:53,578::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:32:53,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000968362', 'lastCheck': '6.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617155', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609588', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:32:53,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a80cdf1-a8a2-46e9-91a6-1f91f0bee2a8`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000968362', 'lastCheck': '6.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617155', 'lastCheck': '5.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609588', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:32:53,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a80cdf1-a8a2-46e9-91a6-1f91f0bee2a8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:32:53,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:32:53,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:32:53,579::task::993::Storage.TaskManager.Task::(_decref) Task=`0a80cdf1-a8a2-46e9-91a6-1f91f0bee2a8`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:32:57,123::__init__::225::IOProcess::(_processLogs) (522) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:57,123::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:57,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:57,123::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:57,123::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:57,124::__init__::225::IOProcess::(_processLogs) (522) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:57,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-82::DEBUG::2014-08-12 19:32:57,125::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:32:57,126::__init__::225::IOProcess::(_processLogs) (523) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:57,133::__init__::225::IOProcess::(_processLogs) (523) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:57,133::__init__::225::IOProcess::(_processLogs) (523) Building response >Thread-29::DEBUG::2014-08-12 19:32:57,133::__init__::225::IOProcess::(_processLogs) (523) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:57,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:57,135::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:32:57,136::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000486002 s, 722 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:32:57,137::__init__::225::IOProcess::(_processLogs) (522) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:32:57,137::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:32:57,137::__init__::225::IOProcess::(_processLogs) (522) Queuing responseDEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:32:57,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:32:57,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:32:57,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:32:57,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:32:57,138::__init__::225::IOProcess::(_processLogs) (524) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:32:57,138::__init__::225::IOProcess::(_processLogs) (524) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:32:57,139::__init__::225::IOProcess::(_processLogs) (522) Queuing responseDEBUG|(524) Building response >Thread-29::DEBUG::2014-08-12 19:32:57,140::__init__::225::IOProcess::(_processLogs) (524) Queuing response >Thread-29::DEBUG::2014-08-12 19:32:57,140::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:32:57,141::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:32:57,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:32:57,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:32:57,827::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701264 s, 5.8 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:32:57,835::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000584431 s, 7.0 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:33:07,141::__init__::225::IOProcess::(_processLogs) (522) Queuing responseDEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:07,141::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:07,142::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:07,142::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:07,142::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:07,142::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:07,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:07,143::__init__::225::IOProcess::(_processLogs) (525) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:07,143::__init__::225::IOProcess::(_processLogs) (525) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:07,143::__init__::225::IOProcess::(_processLogs) DEBUG|(525) Building response >Thread-82::DEBUG::2014-08-12 19:33:07,144::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:33:07,144::__init__::225::IOProcess::(_processLogs) (525) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:07,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:07,152::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:33:07,153::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000291886 s, 1.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:33:07,153::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:07,154::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:07,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:07,154::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:07,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:07,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:07,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:07,155::__init__::225::IOProcess::(_processLogs) (526) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:07,155::__init__::225::IOProcess::(_processLogs) (526) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:07,155::__init__::225::IOProcess::(_processLogs) DEBUG|(526) Building response >Thread-29::DEBUG::2014-08-12 19:33:07,155::__init__::225::IOProcess::(_processLogs) (526) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:07,156::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-29::DEBUG::2014-08-12 19:33:07,157::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:33:07,836::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:07,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614375 s, 6.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:33:07,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:33:07,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638118 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:08,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`d106f3c3-0225-4487-a33b-6db7cfd40a29`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:33:08,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:33:08,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291886', 'lastCheck': '1.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614375', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638118', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:33:08,684::task::1191::Storage.TaskManager.Task::(prepare) Task=`d106f3c3-0225-4487-a33b-6db7cfd40a29`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291886', 'lastCheck': '1.5', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614375', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638118', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:33:08,685::task::595::Storage.TaskManager.Task::(_updateState) Task=`d106f3c3-0225-4487-a33b-6db7cfd40a29`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:33:08,685::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:33:08,685::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:33:08,685::task::993::Storage.TaskManager.Task::(_decref) Task=`d106f3c3-0225-4487-a33b-6db7cfd40a29`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:33:17,158::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:17,159::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:17,159::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:17,159::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:17,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:17,159::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:17,160::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:17,161::__init__::225::IOProcess::(_processLogs) (527) Finding callback 'statvfs'... >Thread-82::DEBUG::2014-08-12 19:33:17,162::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:33:17,162::__init__::225::IOProcess::(_processLogs) (527) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:17,171::__init__::225::IOProcess::(_processLogs) (527) Building response >Thread-82::DEBUG::2014-08-12 19:33:17,172::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000365574 s, 960 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:33:17,172::__init__::225::IOProcess::(_processLogs) (527) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:17,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:17,173::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:33:17,174::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:17,174::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:17,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:17,175::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:17,176::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:17,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:17,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:17,177::__init__::225::IOProcess::(_processLogs) (528) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:17,177::__init__::225::IOProcess::(_processLogs) (528) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:17,177::__init__::225::IOProcess::(_processLogs) (528) Building response >Thread-29::DEBUG::2014-08-12 19:33:17,177::__init__::225::IOProcess::(_processLogs) (528) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:17,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:17,178::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:33:17,854::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:17,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682137 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:33:17,862::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:33:17,870::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700574 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:23,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`88f289a1-1c9d-42d0-aafa-1a9b53869762`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:33:23,790::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:33:23,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365574', 'lastCheck': '6.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682137', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700574', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:33:23,790::task::1191::Storage.TaskManager.Task::(prepare) Task=`88f289a1-1c9d-42d0-aafa-1a9b53869762`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365574', 'lastCheck': '6.6', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682137', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700574', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:33:23,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`88f289a1-1c9d-42d0-aafa-1a9b53869762`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:33:23,791::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:33:23,791::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:33:23,791::task::993::Storage.TaskManager.Task::(_decref) Task=`88f289a1-1c9d-42d0-aafa-1a9b53869762`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:33:27,178::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:27,178::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:27,178::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:27,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:27,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:27,178::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:27,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:27,179::__init__::225::IOProcess::(_processLogs) (529) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:27,179::__init__::225::IOProcess::(_processLogs) (529) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:27,180::__init__::225::IOProcess::(_processLogs) DEBUG|(529) Building response >Thread-29::DEBUG::2014-08-12 19:33:27,181::__init__::225::IOProcess::(_processLogs) (529) Queuing response >Thread-82::DEBUG::2014-08-12 19:33:27,181::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:33:27,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:27,190::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:33:27,190::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000465915 s, 753 kB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:33:27,191::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:27,191::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:27,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:27,192::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:27,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:27,192::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:27,192::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:27,192::__init__::225::IOProcess::(_processLogs) (530) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:27,193::__init__::225::IOProcess::(_processLogs) (530) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:27,193::__init__::225::IOProcess::(_processLogs) DEBUG|(530) Building response >Thread-29::DEBUG::2014-08-12 19:33:27,193::__init__::225::IOProcess::(_processLogs) (530) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:27,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:27,194::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:33:27,870::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:33:27,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:27,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623582 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:33:27,887::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575788 s, 7.1 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:33:37,196::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:37,196::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:37,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:37,197::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:37,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:37,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:37,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:37,197::__init__::225::IOProcess::(_processLogs) (531) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:37,197::__init__::225::IOProcess::(_processLogs) (531) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:37,198::__init__::225::IOProcess::(_processLogs) (531) Building response >Thread-29::DEBUG::2014-08-12 19:33:37,198::__init__::225::IOProcess::(_processLogs) (531) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:37,199::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-82::DEBUG::2014-08-12 19:33:37,200::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:33:37,200::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-82::DEBUG::2014-08-12 19:33:37,209::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000341747 s, 1.0 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:33:37,210::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:37,210::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:37,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:37,211::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:37,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:37,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:37,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:37,213::__init__::225::IOProcess::(_processLogs) (532) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:37,213::__init__::225::IOProcess::(_processLogs) (532) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:37,213::__init__::225::IOProcess::(_processLogs) (532) Building response >Thread-29::DEBUG::2014-08-12 19:33:37,213::__init__::225::IOProcess::(_processLogs) (532) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:37,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:37,214::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:33:37,889::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:33:37,897::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:37,898::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000776279 s, 5.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:33:37,906::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700558 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:38,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1fa13c4-de6f-437a-997c-ec771268b902`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:33:38,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:33:38,929::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341747', 'lastCheck': '1.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000776279', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700558', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:33:38,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1fa13c4-de6f-437a-997c-ec771268b902`::finished: {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341747', 'lastCheck': '1.7', 'valid': True}, '180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000776279', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700558', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:33:38,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1fa13c4-de6f-437a-997c-ec771268b902`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:33:38,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:33:38,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:33:38,929::task::993::Storage.TaskManager.Task::(_decref) Task=`a1fa13c4-de6f-437a-997c-ec771268b902`::ref 0 aborting False >Thread-29::DEBUG::2014-08-12 19:33:47,213::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:47,214::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:47,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:47,215::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-82::DEBUG::2014-08-12 19:33:47,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-29::DEBUG::2014-08-12 19:33:47,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:47,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-82::DEBUG::2014-08-12 19:33:47,226::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n351 bytes (351 B) copied, 0.000292699 s, 1.2 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-08-12 19:33:47,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:47,228::__init__::225::IOProcess::(_processLogs) (533) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:47,228::__init__::225::IOProcess::(_processLogs) (533) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:47,228::__init__::225::IOProcess::(_processLogs) (533) Building response >Thread-29::DEBUG::2014-08-12 19:33:47,228::__init__::225::IOProcess::(_processLogs) (533) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:47,228::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:47,229::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-29::DEBUG::2014-08-12 19:33:47,229::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:47,229::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-29::DEBUG::2014-08-12 19:33:47,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:47,230::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:47,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:47,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:47,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:47,232::__init__::225::IOProcess::(_processLogs) (534) Finding callback 'statvfs'... >Thread-29::DEBUG::2014-08-12 19:33:47,232::__init__::225::IOProcess::(_processLogs) (534) Got request for method 'statvfs' >Thread-29::DEBUG::2014-08-12 19:33:47,233::__init__::225::IOProcess::(_processLogs) (534) Building response >Thread-29::DEBUG::2014-08-12 19:33:47,233::__init__::225::IOProcess::(_processLogs) (534) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:47,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:47,233::__init__::225::IOProcess::(_processLogs) Sending response sized 318 >Thread-16::DEBUG::2014-08-12 19:33:47,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:33:47,916::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:47,917::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652992 s, 6.3 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:33:47,925::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000597117 s, 6.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:50,075::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] >Thread-15::DEBUG::2014-08-12 19:33:50,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f51d897-0070-4e62-95ef-86b1536de7e9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:33:50,077::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='fb5f3025-b514-4fcb-a639-7daae48dfe1a', hostID=1, msdUUID='a217cac4-c442-4af7-9502-bfc17ca3271c', masterVersion=1, domainsMap={'0f3b75de-d8cd-4073-a764-8762b9b6cb75': 'attached', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'}, options=None) >Thread-15::DEBUG::2014-08-12 19:33:50,079::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`f41cd5fb-3889-4753-bdef-ee1aa9e7c6be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-15::DEBUG::2014-08-12 19:33:50,079::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-15::DEBUG::2014-08-12 19:33:50,079::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-15::DEBUG::2014-08-12 19:33:50,079::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`f41cd5fb-3889-4753-bdef-ee1aa9e7c6be`::Granted request >Thread-15::DEBUG::2014-08-12 19:33:50,080::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8f2cff8e-43b8-4c17-aded-f5625a537165`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-15::DEBUG::2014-08-12 19:33:50,080::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' for lock type 'shared' >Thread-15::DEBUG::2014-08-12 19:33:50,080::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free. Now locking as 'shared' (1 active user) >Thread-15::DEBUG::2014-08-12 19:33:50,080::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a`ReqID=`8f2cff8e-43b8-4c17-aded-f5625a537165`::Granted request >Thread-15::DEBUG::2014-08-12 19:33:50,081::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 1 and domains map to {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': 'attached', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'active'} >Thread-15::INFO::2014-08-12 19:33:50,081::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 1 and domains map {'0f3b75de-d8cd-4073-a764-8762b9b6cb75': 'Attached', '180aea8f-26ba-4e87-8a94-37d5469519bf': 'Active', 'a217cac4-c442-4af7-9502-bfc17ca3271c': 'Active'} >Thread-15::DEBUG::2014-08-12 19:33:50,081::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,081::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,082::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,082::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,082::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,082::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,083::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:33:50,083::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:33:50,083::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:33:50,083::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:33:50,083::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:33:50,084::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:33:50,142::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:33:50,144::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-15::DEBUG::2014-08-12 19:33:50,254::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:50,255::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,255::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,255::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,255::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,256::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,256::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,256::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:33:50,256::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,260::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 19:33:50,482::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:50,483::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,483::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-15::DEBUG::2014-08-12 19:33:50,484::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-15::DEBUG::2014-08-12 19:33:50,492::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000608669 s, 3.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:50,493::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000608669 s, 3.4 MB/s'], size: 2048 >Thread-15::DEBUG::2014-08-12 19:33:50,493::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-15::DEBUG::2014-08-12 19:33:50,493::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-15::DEBUG::2014-08-12 19:33:50,493::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-15::DEBUG::2014-08-12 19:33:50,494::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,494::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,494::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,494::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,494::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,495::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-15::DEBUG::2014-08-12 19:33:50,682::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:50,682::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:50,683::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-15::INFO::2014-08-12 19:33:50,684::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-15::INFO::2014-08-12 19:33:50,684::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-15::INFO::2014-08-12 19:33:50,684::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-15::DEBUG::2014-08-12 19:33:50,684::sp::1387::Storage.StoragePool::(setMasterDomain) Master domain a217cac4-c442-4af7-9502-bfc17ca3271c verified, version 1 >Thread-15::DEBUG::2014-08-12 19:33:50,685::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-15::DEBUG::2014-08-12 19:33:50,685::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::INFO::2014-08-12 19:33:50,685::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 0f3b75de-d8cd-4073-a764-8762b9b6cb75 >Thread-82::DEBUG::2014-08-12 19:33:50,685::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 0f3b75de-d8cd-4073-a764-8762b9b6cb75 >Thread-29::DEBUG::2014-08-12 19:33:50,687::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:50,687::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:33:50,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:50,688::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:50,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:50,688::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:50,688::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:50,689::__init__::225::IOProcess::(_processLogs) (535) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:33:50,689::__init__::225::IOProcess::(_processLogs) (535) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:33:50,690::__init__::225::IOProcess::(_processLogs) DEBUG|(535) Building response >Thread-29::DEBUG::2014-08-12 19:33:50,690::__init__::225::IOProcess::(_processLogs) (535) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:50,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:50,690::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-82::DEBUG::2014-08-12 19:33:50,694::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01/0f3b75de-d8cd-4073-a764-8762b9b6cb75 >Thread-29::DEBUG::2014-08-12 19:33:50,695::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:50,695::__init__::225::IOProcess::(_processLogs) Message size is 178 >Thread-29::DEBUG::2014-08-12 19:33:50,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:50,695::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:50,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:50,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:50,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:50,696::__init__::225::IOProcess::(_processLogs) (536) Finding callback 'touch'... >Thread-29::DEBUG::2014-08-12 19:33:50,696::__init__::225::IOProcess::(_processLogs) (536) Got request for method 'touch' >Thread-29::DEBUG::2014-08-12 19:33:50,698::__init__::225::IOProcess::(_processLogs) DEBUG|(536) Building response >Thread-29::DEBUG::2014-08-12 19:33:50,698::__init__::225::IOProcess::(_processLogs) (536) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:50,698::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-82::DEBUG::2014-08-12 19:33:50,699::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-29::DEBUG::2014-08-12 19:33:50,699::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:33:50,701::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-29::DEBUG::2014-08-12 19:33:50,701::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-29::DEBUG::2014-08-12 19:33:50,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:50,701::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-29::DEBUG::2014-08-12 19:33:50,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:50,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:50,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:50,702::__init__::225::IOProcess::(_processLogs) (537) Finding callback 'readfile'... >Thread-29::DEBUG::2014-08-12 19:33:50,702::__init__::225::IOProcess::(_processLogs) (537) Got request for method 'readfile' >Thread-29::DEBUG::2014-08-12 19:33:50,702::__init__::225::IOProcess::(_processLogs) DEBUG|(537) Building response >Thread-29::DEBUG::2014-08-12 19:33:50,703::__init__::225::IOProcess::(_processLogs) (537) Queuing response >Thread-82::DEBUG::2014-08-12 19:33:50,703::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=adf', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', 'REMOTE_PATH=netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'ROLE=Regular', 'SDUUID=0f3b75de-d8cd-4073-a764-8762b9b6cb75', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=cf9cab8cb78003072553cd4116b325ef6d75f836'] >Thread-29::DEBUG::2014-08-12 19:33:50,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:50,705::__init__::225::IOProcess::(_processLogs) Sending response sized 539 >Thread-29::DEBUG::2014-08-12 19:33:50,706::__init__::225::IOProcess::(_processLogs) Message size is 195 >Thread-29::DEBUG::2014-08-12 19:33:50,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:50,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:50,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:50,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:50,708::__init__::225::IOProcess::(_processLogs) (538) Finding callback 'access'... >Thread-29::DEBUG::2014-08-12 19:33:50,708::__init__::225::IOProcess::(_processLogs) (538) Got request for method 'access' >Thread-29::DEBUG::2014-08-12 19:33:50,708::__init__::225::IOProcess::(_processLogs) (538) Building response >Thread-29::DEBUG::2014-08-12 19:33:50,708::__init__::225::IOProcess::(_processLogs) (538) Queuing response >Thread-29::DEBUG::2014-08-12 19:33:50,709::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:50,709::__init__::225::IOProcess::(_processLogs) Sending response sized 73 >Thread-29::DEBUG::2014-08-12 19:33:50,709::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-29::DEBUG::2014-08-12 19:33:50,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:50,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:50,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:50,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:50,710::__init__::225::IOProcess::(_processLogs) (539) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:33:50,710::__init__::225::IOProcess::(_processLogs) (539) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:33:50,711::__init__::225::IOProcess::(_processLogs) (539) Queuing response >Thread-82::DEBUG::2014-08-12 19:33:50,711::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-29::DEBUG::2014-08-12 19:33:50,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-82::INFO::2014-08-12 19:33:50,712::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0f3b75de-d8cd-4073-a764-8762b9b6cb75_imageNS already registered >Thread-29::DEBUG::2014-08-12 19:33:50,713::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-82::INFO::2014-08-12 19:33:50,713::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 0f3b75de-d8cd-4073-a764-8762b9b6cb75_volumeNS already registered >Thread-82::INFO::2014-08-12 19:33:50,714::clusterlock::206::Storage.SANLock::(releaseHostId) Releasing host id for domain 0f3b75de-d8cd-4073-a764-8762b9b6cb75 (id: 1) >Thread-82::DEBUG::2014-08-12 19:33:53,715::clusterlock::216::Storage.SANLock::(releaseHostId) Host id for domain 0f3b75de-d8cd-4073-a764-8762b9b6cb75 released successfully (id: 1) >Thread-15::DEBUG::2014-08-12 19:33:53,716::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `fb5f3025-b514-4fcb-a639-7daae48dfe1a` stopped monitoring domain `0f3b75de-d8cd-4073-a764-8762b9b6cb75` >Thread-15::DEBUG::2014-08-12 19:33:53,716::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:33:53,716::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a >Thread-15::WARNING::2014-08-12 19:33:53,716::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a already exists >Thread-15::DEBUG::2014-08-12 19:33:53,717::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:53,717::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-15::DEBUG::2014-08-12 19:33:53,902::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:53,903::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:53,903::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md >Thread-15::WARNING::2014-08-12 19:33:53,903::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/dom_md already exists >Thread-15::DEBUG::2014-08-12 19:33:53,903::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images >Thread-15::WARNING::2014-08-12 19:33:53,904::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf/images already exists >Thread-29::DEBUG::2014-08-12 19:33:53,905::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-29::DEBUG::2014-08-12 19:33:53,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-29::DEBUG::2014-08-12 19:33:53,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-29::DEBUG::2014-08-12 19:33:53,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-29::DEBUG::2014-08-12 19:33:53,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-29::DEBUG::2014-08-12 19:33:53,906::__init__::225::IOProcess::(_processLogs) (540) Finding callback 'glob'... >Thread-29::DEBUG::2014-08-12 19:33:53,906::__init__::225::IOProcess::(_processLogs) (540) Got request for method 'glob' >Thread-29::DEBUG::2014-08-12 19:33:53,907::__init__::225::IOProcess::(_processLogs) (540) Queuing response >Thread-15::INFO::2014-08-12 19:33:53,908::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-29::DEBUG::2014-08-12 19:33:53,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-29::DEBUG::2014-08-12 19:33:53,909::__init__::225::IOProcess::(_processLogs) Sending response sized 199 >Thread-15::DEBUG::2014-08-12 19:33:53,909::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/180aea8f-26ba-4e87-8a94-37d5469519bf to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-15::DEBUG::2014-08-12 19:33:53,910::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images >Thread-15::WARNING::2014-08-12 19:33:53,910::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/images already exists >Thread-15::DEBUG::2014-08-12 19:33:53,910::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md >Thread-15::WARNING::2014-08-12 19:33:53,910::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c/dom_md already exists >Thread-15::INFO::2014-08-12 19:33:53,911::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::DEBUG::2014-08-12 19:33:53,911::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-15::INFO::2014-08-12 19:33:53,911::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 19:33:53,912::sp::1135::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/a217cac4-c442-4af7-9502-bfc17ca3271c to /rhev/data-center/fb5f3025-b514-4fcb-a639-7daae48dfe1a/mastersd >Thread-15::DEBUG::2014-08-12 19:33:53,912::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' >Thread-15::DEBUG::2014-08-12 19:33:53,912::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' (0 active users) >Thread-15::DEBUG::2014-08-12 19:33:53,912::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:33:53,912::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fb5f3025-b514-4fcb-a639-7daae48dfe1a', Clearing records. >Thread-15::DEBUG::2014-08-12 19:33:53,913::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-15::DEBUG::2014-08-12 19:33:53,913::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-15::DEBUG::2014-08-12 19:33:53,913::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-15::DEBUG::2014-08-12 19:33:53,913::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-15::INFO::2014-08-12 19:33:53,913::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-15::DEBUG::2014-08-12 19:33:53,914::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f51d897-0070-4e62-95ef-86b1536de7e9`::finished: True >Thread-15::DEBUG::2014-08-12 19:33:53,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f51d897-0070-4e62-95ef-86b1536de7e9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:33:53,914::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:33:53,914::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:33:53,914::task::993::Storage.TaskManager.Task::(_decref) Task=`4f51d897-0070-4e62-95ef-86b1536de7e9`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:33:53,945::BindingXMLRPC::318::vds::(wrapper) client [10.35.161.45] flowID [7d6d79d6] >Thread-15::DEBUG::2014-08-12 19:33:53,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`602a2ffa-d262-473d-a010-81d702a41a9b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:33:53,946::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'port': '', 'connection': 'netapp.qa.lab.tlv.redhat.com:/vol/vol_gamado_nfs01', 'iqn': '', 'user': '', 'tpgt': '1', 'protocol_version': '3', 'password': '******', 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}], options=None) >Thread-15::DEBUG::2014-08-12 19:33:53,946::mount::202::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/netapp.qa.lab.tlv.redhat.com:_vol_vol__gamado__nfs01 (cwd None) >Thread-15::DEBUG::2014-08-12 19:33:54,003::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-08-12 19:33:54,003::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:33:54,004::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-08-12 19:33:54,004::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-08-12 19:33:54,004::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-08-12 19:33:54,004::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-15::DEBUG::2014-08-12 19:33:54,033::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-08-12 19:33:54,040::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-28::DEBUG::2014-08-12 19:33:54,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1951b61-9f4e-4a5c-809a-a6b59b4a04eb`::moving from state init -> state preparing >Thread-28::INFO::2014-08-12 19:33:54,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-08-12 19:33:54,058::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652992', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597117', 'lastCheck': '6.1', 'valid': True}} >Thread-28::DEBUG::2014-08-12 19:33:54,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1951b61-9f4e-4a5c-809a-a6b59b4a04eb`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000652992', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000597117', 'lastCheck': '6.1', 'valid': True}} >Thread-28::DEBUG::2014-08-12 19:33:54,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1951b61-9f4e-4a5c-809a-a6b59b4a04eb`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-08-12 19:33:54,059::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-08-12 19:33:54,059::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-08-12 19:33:54,059::task::993::Storage.TaskManager.Task::(_decref) Task=`d1951b61-9f4e-4a5c-809a-a6b59b4a04eb`::ref 0 aborting False >Thread-15::DEBUG::2014-08-12 19:33:54,102::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:33:54,103::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:54,103::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:54,103::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:54,103::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:54,104::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:54,104::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-08-12 19:33:54,104::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-15::INFO::2014-08-12 19:33:54,104::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}]} >Thread-15::DEBUG::2014-08-12 19:33:54,104::task::1191::Storage.TaskManager.Task::(prepare) Task=`602a2ffa-d262-473d-a010-81d702a41a9b`::finished: {'statuslist': [{'status': 0, 'id': '163af0e7-dfb9-47e1-a38a-9e10a273a8b0'}]} >Thread-15::DEBUG::2014-08-12 19:33:54,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`602a2ffa-d262-473d-a010-81d702a41a9b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:33:54,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:33:54,105::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:33:54,105::task::993::Storage.TaskManager.Task::(_decref) Task=`602a2ffa-d262-473d-a010-81d702a41a9b`::ref 0 aborting False >Thread-16::DEBUG::2014-08-12 19:33:57,926::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:57,929::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:33:57,937::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 19:33:58,129::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:33:58,130::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:58,139::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:33:58,141::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623976 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:33:58,141::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,142::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:33:58,142::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,144::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:33:58,144::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:58,158::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000564081 s, 3.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:33:58,158::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000564081 s, 3.6 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:33:58,159::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:33:58,159::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:33:58,159::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:33:58,160::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-17::DEBUG::2014-08-12 19:33:58,331::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:33:58,332::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,332::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,334::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,336::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,337::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,338::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,338::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:58,520::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:33:58,520::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:33:58,520::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 19:33:58,521::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 19:33:58,522::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:33:58,522::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 19:33:58,522::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:58,690::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:33:58,691::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:33:58,699::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683361 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:34:08,347::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:08,355::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630823 s, 6.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:08,700::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:08,707::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621746 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:34:09,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`db720e46-9623-4305-b5b3-109ffa263c7d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:34:09,220::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:34:09,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621746', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630823', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:34:09,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`db720e46-9623-4305-b5b3-109ffa263c7d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621746', 'lastCheck': '0.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630823', 'lastCheck': '0.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:34:09,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`db720e46-9623-4305-b5b3-109ffa263c7d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:34:09,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:34:09,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:34:09,221::task::993::Storage.TaskManager.Task::(_decref) Task=`db720e46-9623-4305-b5b3-109ffa263c7d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:34:18,360::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a217cac4-c442-4af7-9502-bfc17ca3271c >Thread-17::DEBUG::2014-08-12 19:34:18,360::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:34:18,360::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:18,369::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00053036 s, 3.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:34:18,369::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00053036 s, 3.9 MB/s'], size: 2048 >Thread-17::DEBUG::2014-08-12 19:34:18,369::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-17::DEBUG::2014-08-12 19:34:18,370::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-17::DEBUG::2014-08-12 19:34:18,370::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-17::DEBUG::2014-08-12 19:34:18,370::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:34:18,370::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:34:18,371::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:34:18,371::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:34:18,371::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-08-12 19:34:18,371::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:18,637::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:34:18,637::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-08-12 19:34:18,638::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=xxvdZx-74j4-WdoF-qB8U-aAeS-B5HH-I4IHIu', 'VERSION=3', u'PV0=pv:360060160128230005cdddcba33f2e311,uuid:H5tDpx-rv0R-fto0-8htx-Za7q-aB5N-wuTgIT,pestart:0,pecount:317,mapoffset:0', 'LOGBLKSIZE=512', 'TYPE=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'SDUUID=a217cac4-c442-4af7-9502-bfc17ca3271c', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LOCKPOLICY=', 'POOL_DOMAINS=a217cac4-c442-4af7-9502-bfc17ca3271c:Active', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=datacenter_iscsi_storage_cov', 'ROLE=Master', '_SHA_CKSUM=f8bd4f36ec89e8b7e75acdc9b4710f245808bd5e', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a'] >Thread-17::INFO::2014-08-12 19:34:18,639::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_imageNS already registered >Thread-17::INFO::2014-08-12 19:34:18,639::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_volumeNS already registered >Thread-17::INFO::2014-08-12 19:34:18,639::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a217cac4-c442-4af7-9502-bfc17ca3271c_lvmActivationNS already registered >Thread-17::DEBUG::2014-08-12 19:34:18,640::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' a217cac4-c442-4af7-9502-bfc17ca3271c (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:18,709::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 180aea8f-26ba-4e87-8a94-37d5469519bf >Thread-16::DEBUG::2014-08-12 19:34:18,709::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:34:18,725::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:18,734::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000655151 s, 3.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:18,735::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000655151 s, 3.1 MB/s'], size: 2048 >Thread-16::DEBUG::2014-08-12 19:34:18,735::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-16::DEBUG::2014-08-12 19:34:18,735::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-16::DEBUG::2014-08-12 19:34:18,735::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-16::DEBUG::2014-08-12 19:34:18,736::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:34:18,736::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:34:18,736::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:34:18,736::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:34:18,737::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-16::DEBUG::2014-08-12 19:34:18,737::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:18,807::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:34:18,807::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:18,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598649 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:18,920::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:18,920::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-16::DEBUG::2014-08-12 19:34:18,920::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VERSION=3', 'TYPE=ISCSI', 'SDUUID=180aea8f-26ba-4e87-8a94-37d5469519bf', u'PV0=pv:3600601601282300060dddcba33f2e311,uuid:98MWHB-6YCg-Ft80-Gig2-WaP0-Liws-qMyXsP,pestart:0,pecount:317,mapoffset:0', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=DJqgKn-BptR-ETvo-PLba-Qc12-NNza-hvjDQc', 'CLASS=Data', 'DESCRIPTION=iscsi_1', 'POOL_UUID=fb5f3025-b514-4fcb-a639-7daae48dfe1a', '_SHA_CKSUM=189d056969591a327adf4c729525fafb366effde'] >Thread-16::INFO::2014-08-12 19:34:18,921::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_imageNS already registered >Thread-16::INFO::2014-08-12 19:34:18,921::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_volumeNS already registered >Thread-16::INFO::2014-08-12 19:34:18,921::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 180aea8f-26ba-4e87-8a94-37d5469519bf_lvmActivationNS already registered >Thread-16::DEBUG::2014-08-12 19:34:18,922::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600601601282300060dddcba33f2e311|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' 180aea8f-26ba-4e87-8a94-37d5469519bf (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:19,090::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:19,090::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:19,098::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600639 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:34:24,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ae302c0-2970-46b9-800b-a89b3fe6a2dd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:34:24,362::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:34:24,362::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600639', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598649', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:34:24,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ae302c0-2970-46b9-800b-a89b3fe6a2dd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600639', 'lastCheck': '5.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598649', 'lastCheck': '5.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:34:24,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ae302c0-2970-46b9-800b-a89b3fe6a2dd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:34:24,363::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:34:24,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:34:24,363::task::993::Storage.TaskManager.Task::(_decref) Task=`5ae302c0-2970-46b9-800b-a89b3fe6a2dd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:34:28,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:28,828::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731469 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:29,100::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:29,108::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644187 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:34:38,841::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:38,849::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657636 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:39,110::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:39,117::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656503 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:34:39,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`f83f35fd-e950-4b4e-a380-cef96efab8da`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:34:39,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:34:39,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656503', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657636', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:34:39,495::task::1191::Storage.TaskManager.Task::(prepare) Task=`f83f35fd-e950-4b4e-a380-cef96efab8da`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656503', 'lastCheck': '0.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657636', 'lastCheck': '0.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:34:39,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`f83f35fd-e950-4b4e-a380-cef96efab8da`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:34:39,495::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:34:39,496::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:34:39,496::task::993::Storage.TaskManager.Task::(_decref) Task=`f83f35fd-e950-4b4e-a380-cef96efab8da`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:34:48,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:48,861::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661945 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:49,119::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:49,127::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764422 s, 5.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:34:54,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`a41d6ad3-b512-4660-845c-91fa685e95cd`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:34:54,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:34:54,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764422', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661945', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:34:54,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`a41d6ad3-b512-4660-845c-91fa685e95cd`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764422', 'lastCheck': '5.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661945', 'lastCheck': '5.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:34:54,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`a41d6ad3-b512-4660-845c-91fa685e95cd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:34:54,623::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:34:54,623::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:34:54,623::task::993::Storage.TaskManager.Task::(_decref) Task=`a41d6ad3-b512-4660-845c-91fa685e95cd`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:34:58,864::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:34:58,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000778764 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:34:59,129::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:34:59,138::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679105 s, 6.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:35:08,876::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:35:08,884::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693382 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:35:09,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:35:09,146::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627789 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:35:09,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ee94bff-80d1-4665-9fab-12164ff1f0a6`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:35:09,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:35:09,734::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627789', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693382', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:35:09,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ee94bff-80d1-4665-9fab-12164ff1f0a6`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627789', 'lastCheck': '0.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693382', 'lastCheck': '0.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:35:09,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ee94bff-80d1-4665-9fab-12164ff1f0a6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:35:09,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:35:09,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:35:09,735::task::993::Storage.TaskManager.Task::(_decref) Task=`7ee94bff-80d1-4665-9fab-12164ff1f0a6`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:35:18,887::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:35:18,896::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664534 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:35:19,147::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:35:19,155::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070493 s, 5.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:35:24,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd366dd8-a55c-49b0-a3cd-e545205d7263`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:35:24,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:35:24,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070493', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664534', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:35:24,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd366dd8-a55c-49b0-a3cd-e545205d7263`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070493', 'lastCheck': '5.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664534', 'lastCheck': '5.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:35:24,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd366dd8-a55c-49b0-a3cd-e545205d7263`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:35:24,846::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:35:24,847::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:35:24,847::task::993::Storage.TaskManager.Task::(_decref) Task=`fd366dd8-a55c-49b0-a3cd-e545205d7263`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:35:28,900::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:35:28,907::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000811249 s, 5.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:35:29,157::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:35:29,165::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000595381 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:35:38,911::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:35:38,918::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738368 s, 5.5 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:35:39,167::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:35:39,174::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698853 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:35:39,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffa578c8-3ef0-4d0d-bf70-77c868093c13`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:35:39,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:35:39,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698853', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738368', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:35:39,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffa578c8-3ef0-4d0d-bf70-77c868093c13`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698853', 'lastCheck': '0.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000738368', 'lastCheck': '1.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:35:39,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffa578c8-3ef0-4d0d-bf70-77c868093c13`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:35:39,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:35:39,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:35:39,951::task::993::Storage.TaskManager.Task::(_decref) Task=`ffa578c8-3ef0-4d0d-bf70-77c868093c13`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:35:48,922::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:35:48,931::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642702 s, 6.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:35:49,175::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:35:49,183::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634505 s, 6.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:35:55,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e95e092-327b-4800-8132-109e8db3940c`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:35:55,059::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:35:55,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634505', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642702', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:35:55,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e95e092-327b-4800-8132-109e8db3940c`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634505', 'lastCheck': '5.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642702', 'lastCheck': '6.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:35:55,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e95e092-327b-4800-8132-109e8db3940c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:35:55,060::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:35:55,060::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:35:55,060::task::993::Storage.TaskManager.Task::(_decref) Task=`6e95e092-327b-4800-8132-109e8db3940c`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:35:58,934::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:35:58,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759788 s, 5.4 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:35:59,184::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:35:59,193::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730384 s, 5.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:36:08,945::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:36:08,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677717 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:36:09,203::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:36:09,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722079 s, 5.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:36:10,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`1dd0d5fb-41d4-40f7-8840-5ec6874fa1e5`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:36:10,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:36:10,195::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722079', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677717', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:36:10,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`1dd0d5fb-41d4-40f7-8840-5ec6874fa1e5`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722079', 'lastCheck': '1.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677717', 'lastCheck': '1.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:36:10,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`1dd0d5fb-41d4-40f7-8840-5ec6874fa1e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:36:10,199::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:36:10,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:36:10,201::task::993::Storage.TaskManager.Task::(_decref) Task=`1dd0d5fb-41d4-40f7-8840-5ec6874fa1e5`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:36:18,956::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:36:18,964::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602537 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:36:19,213::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:36:19,221::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688919 s, 5.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:36:25,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a5836a2-e8d2-4c1e-a2ee-d60db7e17b8b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:36:25,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:36:25,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000688919', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602537', 'lastCheck': '6.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:36:25,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a5836a2-e8d2-4c1e-a2ee-d60db7e17b8b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000688919', 'lastCheck': '6.1', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602537', 'lastCheck': '6.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:36:25,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a5836a2-e8d2-4c1e-a2ee-d60db7e17b8b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:36:25,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:36:25,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:36:25,320::task::993::Storage.TaskManager.Task::(_decref) Task=`0a5836a2-e8d2-4c1e-a2ee-d60db7e17b8b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:36:28,968::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:36:28,975::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709356 s, 5.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:36:29,223::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:36:29,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719735 s, 5.7 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:36:38,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:36:38,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006861 s, 6.0 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:36:39,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:36:39,241::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000599657 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:36:40,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d9378b7-cf03-40c9-9ad2-1a22cc674c4e`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:36:40,425::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:36:40,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599657', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006861', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:36:40,425::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d9378b7-cf03-40c9-9ad2-1a22cc674c4e`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599657', 'lastCheck': '1.2', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006861', 'lastCheck': '1.4', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:36:40,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d9378b7-cf03-40c9-9ad2-1a22cc674c4e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:36:40,425::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:36:40,426::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:36:40,426::task::993::Storage.TaskManager.Task::(_decref) Task=`1d9378b7-cf03-40c9-9ad2-1a22cc674c4e`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:36:48,991::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:36:48,999::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623961 s, 6.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:36:49,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:36:49,251::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683187 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:36:55,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`92b8beb1-20da-4faa-813a-0f787cbee1c9`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:36:55,532::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:36:55,533::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683187', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623961', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:36:55,533::task::1191::Storage.TaskManager.Task::(prepare) Task=`92b8beb1-20da-4faa-813a-0f787cbee1c9`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683187', 'lastCheck': '6.3', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623961', 'lastCheck': '6.5', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:36:55,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`92b8beb1-20da-4faa-813a-0f787cbee1c9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:36:55,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:36:55,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:36:55,533::task::993::Storage.TaskManager.Task::(_decref) Task=`92b8beb1-20da-4faa-813a-0f787cbee1c9`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:36:59,002::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:36:59,011::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713179 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:36:59,253::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:36:59,262::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642938 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:37:09,014::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:37:09,023::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667325 s, 6.1 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:37:09,263::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:37:09,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006096 s, 6.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:37:10,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`432ae84a-d6bc-477c-9448-fcf6f537b060`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:37:10,644::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:37:10,644::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006096', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667325', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:37:10,644::task::1191::Storage.TaskManager.Task::(prepare) Task=`432ae84a-d6bc-477c-9448-fcf6f537b060`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006096', 'lastCheck': '1.4', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667325', 'lastCheck': '1.6', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:37:10,644::task::595::Storage.TaskManager.Task::(_updateState) Task=`432ae84a-d6bc-477c-9448-fcf6f537b060`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:37:10,645::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:37:10,645::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:37:10,645::task::993::Storage.TaskManager.Task::(_decref) Task=`432ae84a-d6bc-477c-9448-fcf6f537b060`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:37:19,026::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:37:19,034::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060655 s, 6.8 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:37:19,274::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:37:19,282::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642101 s, 6.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:37:25,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`36a12478-2c96-415f-bb90-47fda8429ef2`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:37:25,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:37:25,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642101', 'lastCheck': '6.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060655', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:37:25,759::task::1191::Storage.TaskManager.Task::(prepare) Task=`36a12478-2c96-415f-bb90-47fda8429ef2`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642101', 'lastCheck': '6.5', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060655', 'lastCheck': '6.7', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:37:25,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`36a12478-2c96-415f-bb90-47fda8429ef2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:37:25,759::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:37:25,760::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:37:25,760::task::993::Storage.TaskManager.Task::(_decref) Task=`36a12478-2c96-415f-bb90-47fda8429ef2`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:37:29,038::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:37:29,047::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721235 s, 5.7 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:37:29,284::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:37:29,292::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616962 s, 6.6 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:37:39,050::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:37:39,059::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000689609 s, 5.9 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:37:39,293::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:37:39,301::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617021 s, 6.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:37:40,870::task::595::Storage.TaskManager.Task::(_updateState) Task=`35ff63e8-f409-466d-b258-3889fd37838b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:37:40,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:37:40,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617021', 'lastCheck': '1.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689609', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:37:40,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`35ff63e8-f409-466d-b258-3889fd37838b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617021', 'lastCheck': '1.6', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689609', 'lastCheck': '1.8', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:37:40,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`35ff63e8-f409-466d-b258-3889fd37838b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:37:40,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:37:40,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:37:40,871::task::993::Storage.TaskManager.Task::(_decref) Task=`35ff63e8-f409-466d-b258-3889fd37838b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:37:49,062::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:37:49,070::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662725 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:37:49,302::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:37:49,311::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000679238 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:37:55,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`6072e567-1ab0-40df-9c35-2dbc88dadc8b`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:37:55,973::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:37:55,974::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679238', 'lastCheck': '6.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662725', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:37:55,974::task::1191::Storage.TaskManager.Task::(prepare) Task=`6072e567-1ab0-40df-9c35-2dbc88dadc8b`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000679238', 'lastCheck': '6.7', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662725', 'lastCheck': '6.9', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:37:55,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`6072e567-1ab0-40df-9c35-2dbc88dadc8b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:37:55,974::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:37:55,974::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:37:55,975::task::993::Storage.TaskManager.Task::(_decref) Task=`6072e567-1ab0-40df-9c35-2dbc88dadc8b`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:37:59,074::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:37:59,082::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000733563 s, 5.6 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:37:59,312::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:37:59,321::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00059518 s, 6.9 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:38:09,085::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:38:09,095::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000768494 s, 5.3 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:38:09,323::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:38:09,331::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735802 s, 5.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:38:11,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`936f8a86-18b3-484a-b0d1-723585830e19`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:38:11,090::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:38:11,090::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735802', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000768494', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:38:11,091::task::1191::Storage.TaskManager.Task::(prepare) Task=`936f8a86-18b3-484a-b0d1-723585830e19`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735802', 'lastCheck': '1.8', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000768494', 'lastCheck': '2.0', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:38:11,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`936f8a86-18b3-484a-b0d1-723585830e19`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:38:11,091::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:38:11,091::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:38:11,091::task::993::Storage.TaskManager.Task::(_decref) Task=`936f8a86-18b3-484a-b0d1-723585830e19`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:38:19,098::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:38:19,106::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657273 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:38:19,332::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:38:19,341::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065689 s, 6.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:38:26,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cdaeb2b-51d5-45c9-bfa0-ba7e61598a1d`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:38:26,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:38:26,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065689', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657273', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:38:26,200::task::1191::Storage.TaskManager.Task::(prepare) Task=`7cdaeb2b-51d5-45c9-bfa0-ba7e61598a1d`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00065689', 'lastCheck': '6.9', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657273', 'lastCheck': '7.1', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:38:26,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cdaeb2b-51d5-45c9-bfa0-ba7e61598a1d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:38:26,200::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:38:26,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:38:26,201::task::993::Storage.TaskManager.Task::(_decref) Task=`7cdaeb2b-51d5-45c9-bfa0-ba7e61598a1d`::ref 0 aborting False >Thread-17::DEBUG::2014-08-12 19:38:29,109::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:38:29,117::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00079208 s, 5.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:38:29,342::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:38:29,351::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000640053 s, 6.4 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-08-12 19:38:39,120::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/a217cac4-c442-4af7-9502-bfc17ca3271c/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-08-12 19:38:39,129::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066389 s, 6.2 MB/s\n'; <rc> = 0 >Thread-16::DEBUG::2014-08-12 19:38:39,352::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/180aea8f-26ba-4e87-8a94-37d5469519bf/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-16::DEBUG::2014-08-12 19:38:39,361::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000606629 s, 6.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-08-12 19:38:41,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`1936b8b9-e29d-4ed4-afd1-cf82033e2062`::moving from state init -> state preparing >Thread-15::INFO::2014-08-12 19:38:41,318::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-08-12 19:38:41,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606629', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066389', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:38:41,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`1936b8b9-e29d-4ed4-afd1-cf82033e2062`::finished: {'180aea8f-26ba-4e87-8a94-37d5469519bf': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606629', 'lastCheck': '2.0', 'valid': True}, 'a217cac4-c442-4af7-9502-bfc17ca3271c': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066389', 'lastCheck': '2.2', 'valid': True}} >Thread-15::DEBUG::2014-08-12 19:38:41,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`1936b8b9-e29d-4ed4-afd1-cf82033e2062`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-08-12 19:38:41,319::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-08-12 19:38:41,319::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-08-12 19:38:41,319::task::993::Storage.TaskManager.Task::(_decref) Task=`1936b8b9-e29d-4ed4-afd1-cf82033e2062`::ref 0 aborting False
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1129398
:
926159
| 926160